If you say it doesn't want to back or stop the boat, it might be a problem with your prop.
Have you checked that?
Are you talking about prop walk?
Most boats drift left in reverse, known as prop walk.
All are different and react different, but this is normal.
Courtney is My Hero
If a man is to be obsessed by something, I suppose a boat is as good as anything, perhaps a bit better than most - E.B. White