Is fast worth it?
Having a J-24 presently for sale, but likly to far for you to travel? I will give you my slanted view of your question.
J-24 are fast and fun, Yes some of the other boats are also fast and fun. but no other boat on your list has close to 5400 hulls built todate and still building 20 plus per year.
There are web sites, local racing,and a strong class association. Every one has seen or sailed a j-24 at one time so when it comes time to sell, it should not take forever. I presently race my J-24 in a Perf fleet the boat is rated 174 on our lake. for some reason I got stuck with a 165 rating which is the problem with Perf racing. as for the question of "Is fast worth it" after a stunt of cat sailing, every boat you listed, will seem slow!
the reason we are selling the J is that we live 2 hours from where we sail and would like a boat that we can stand in while down below.