Have you motored beside these other boats to see if you are indeed that slow? Is the 4 knots indicated boat speed or
GPS groundspeed?
I'm sure you can feel the difference in boat speeds, (between 4 and 6 knots, for example) but part of your problem might be instrumental (knotmeter or tach??).