Julie, have a look at the 4-part article by James Baldwin:
Atom Voyages - The Long Way Back to Brazil (Part 1)
Basically, at the bulge of Brazil, the current and winds push north. It's an easy sail up to the Caribbean, but a real slog the other way. That's the reason few people do it.