Woot woot - old Scarborough native here too (Malvern area). Just moved to Pickering - boy what a difference LOL
As mentioned try out Scarb Bluffs, Frenchmans Bay, Duffins creek, and even Twynn Rivers.
I used to keep a quick portable twig in the trunk of my car and every time I'd pass through...