My only advice has nothing to do with a particular boat. But as your kids grow, they'll develop social and recreational needs that may make this lifestyle difficult. I'm taking about sleepovers, birthday parties, soccer, tee ball... you get the idea. I'm not sure you and wife know yet the degree to which your priorities and lives are going to change. It will be hard (and maybe some would say unfair) to deny your kids the activities all their friends will be involved with.
So my advice? Go for it, but do so with an eye towards being able to "get out of it" with relative ease... get a mainstream popular boat that will be (relatively) easy to re-sell.