Re: who had right away?
Many 'watermen' steer from amidships with a 'stick - tiller' leaving the wheel alone/vacant.
He probably was working amidships, didnt see you because his view was blocked by the wheelhouse etc.
Where was your HORN?
Just a slight 'beep' to get his attention sometimes is all thats needed, if not then 5 one-second blasts followed by a friendly wave will get someone's attention.
Yes indeed many lobster and crab boats are operated by a single person working their azzes off ... and for prudence you should either 'alert' them from harmful developing situations or just a simply quick 'beep' on the horn is all thats needed. :-)