I have always been under the impression that boats "fishing" we're the big boys. Not the 6 pack charter or recreational rod & reel crowd. Even if you're trolling 6 lines behind the boat you are still able to manuver easier than a sailboat.
In your case the captain of that vessel is probably wrong. Not much you can do about because you are after all, a rag merchant