The Caymans has some of the best diving in the world.
It does not have some of the best golf in the world.
Used to be a restaurant in town that had all you can eat lobster 2(?) nights a week. Decker's, I think. There was a English, double decker bus out front if I recall. But it's been years ago since I have been there.
+1
I go every other year, my kids love it. Decker's is alive and well, as is the lobster special. The Wharf also has decent food at the south end of 7-mile, and head a bit further south for Casanova's (Italian food, outdoor seating with a nice view). If you don't mind a longer ride, you can check out the Barefoot Man - the Cayman version of Jimmy Buffet. If you want to drink and shop with the cruise ship crowd, head into town any day and have at it!
If you do not dive, there is also great snorkeling. You can take a tour, or just go on your own to Cemetery Beach and/or Eden Rock (Eden Rock is the best so if you only do one, go there). There is a dive shop right there for rentals if you need it. Early morning is great, I usually see eel, tarpon (some really big ones), squid, cudas and a lot of all the usual Caribbean fish.
Tourist traps/stuff = iguanas, turtle farm, dolphin swim, stingray city (avoid the busy cruise ship times as it can get too crowded). We've done them all at one time or another.
Dive, snorkel, beach, eat and repeat.