The crab pots are in the shallows. If you stay out deeper than 20 feet, you're usually ok.
However, I go for the shallows to mitigate opposing current. On the Eastport-Solomons Race a few weekends ago, I failed to dodge a pot and snagged it with my rudder. Wasted 7-10 minutes getting it off with the boathook.