Brak...Do get that guide...once you do you will be unable to put it down...there are YEARS of weekends in that book!!
Two of our favorite places are Solomons Island and St. Mike's in your area.
We used to keep our boat further down the Bay south of the Potomac but always stopped at those two towns on our jaunts north.
One of the most interesting places to see by boat that really suprised us was the City of Baltimore. That is probably best saved for when you have a really long weekend but it is an easy trip and a wonderful place to hang out. From the waterfront you have walking distance access to malls, the science museum, the aquarium (incredible), Little Italy, and you can even walk to an Orioles game. You CAN anchor right off the mall but there is a lot of bottom debris so I always take a slip and use the water taxi to get around.
Have fun out there!