I had the bearing replaced twice on Asylum. The first yard had to drop the rudder, pull the shaft, and then removed the bearing. Nasty job. Expensive
However, Deaton's in Oriental, NC did it a few years ago and was able to pull the bearing out around the shaft and with the rudder turned had enough clearance to to simply pull the prop and slip the bearing out. The set screws that hold the bearing are exposed, you remove the set screws and use picks in the holes to free up the bearing and slide it aft. Frankly I was amazed at their skill in getting the bearing out without removing the shaft.
In my opinion, PSC did not do a great job of designing this for easy owner removal. But I was relieved to see that a good Yard could get the job done easily.