We always wear our inflatable pfd's, just in case someone (me aka mom) needs to go after a kid and also to set a good example. But our kids are small (1 & 3) and there is honestly no way I'm not going in after them. We try to bring guests with us when possible, so they get the job of keeping an eye on the kid and mom overboard while my husband brings the boat around.
Inflatable pfd's are great for hanging out in the water while someone picks you up.
If your plan it to swim with one I would test that plan.
With some inflatable's swimming is impossible.