Here's one optional plan: sail upwind away from the harbor entrance (so that you're not in the way of other traffic) until you're about a mile away.
I would start by going out with no wind (motoring). Next time go out in an easy offshore breeze. You don't want to get a couple boat lengths outside the harbor and flub a tack on a lee shore. Makes me much more comfortable to have the rocks to weather.