If you're by high park, I would suggest you try humber marina or ashbridges first. the hike going back to kingston if you're taking the bus is quite a walk and a good exercise but the place is beautiful. great fishing spot for bass pike and carp.
From Victoria Pk station take the Kingston 12 all the way to the end ( Barkdene Hills & Brimley ) and walk Brimley south. As others have said - the walk up is brutal but you get to fish a pretty sweet area