A good tiller pilot is only about $500-600 or so...not $2000... and is far more useful when singlehanding than a tiller tamer IMHO.
For jacklines, my favorite jacklines are made of polyester webbing with a spectra line core. The webbing is basically to protect the spectra core from abrasion and UV. You can also get regular polyester webbing jacklines. Don't get the nylon webbing for jacklines—it is far to elastic.
As for harnesses, I prefer them to be integrated with the PFD.... this makes it much simpler to get them on and off, as well as reduces the amount of gear you have to wear and the time it takes to adjust everything when you add/remove layers or foul weather gear. The one I use personally is a Spinlock Deckware Pro harness with PFD. One caveat, it isn't USCG approved, even though it is SOLAS approved. The SOLAS standards are much stricter and more difficult to meet IMHO. It came with a whistle, spray hood and water-activated strobe.
BTW, some of the Mustang inflatable PFDs have optional harnesses you can purchase. This is probably better than getting standalone harnesses. Don't forget to get a crotch strap for the PFD/harness... since having them pulled over your head is a possible problem. The Spinlocks come with thigh straps, which are much more comfortable IMHO.
Tethers—I prefer the double leg tethers. One leg is one meter, the other is two meters long... it is very convenient and allows you to stay clipped in all the time. I'd recommend getting the ISAF-approved tethers, since they have the strain/overload indicators as part of their design. You'll want safety hooks, like the Gibb or Wichard double-action ones, on the boat/jackline end and a snap shackle on the body end. This is so you can release the body end of the tether if necessary.
A good rigging knife and/or pocket tool. The rigging knives I like are the Boye's rigging knives, since they will cut synthetic lines better than almost anything else, and they never rust. The pocket tool I carry is a Leatherman Core, which is the first one to come out with a decent set of scissors.
Hand-bearing compass and good binoculars are both worth having aboard. 7x50 binoculars are pretty standard and allow you pretty good low-light vision and decent magnification. The Plastimo Iris 50 is a good hand-bearing compass—and about the size of a hockey puck and it floats—get it in yellow, not blue...much easier to see if you drop it in the water.
The in-the-water deployable ladders are nice and all...but IMHO, especially with 50˚ water temps, you would really be much better off staying on the boat.
For when you're not single-handing.... a LifeSling2 is an excellent investment. One of the best pieces of safety gear you can get for doing MOB recoveries. Also, it qualifies as a USCG Type IV throwable PFD.