There are sail and oar dinghies meant for this type of use. They tend to be designed to row or sail well and have larger capacity than the racing dinghies that you mentioned.
This is an example that a friend owns:
Grapeview Point Boat Works' Caledonia Yawl
I've seen it, but haven't had a chance to sail it yet.