Coincidental to Sean's post, I'd just been thinking about the value (and relevance to this thread) of his own, personal rating system, ie
3* Don't miss for any reason
2* Plan a trip around this course
1* Worth the expense of an overnight stay
R Worth a significant day trip (no more driving than it takes to play and have drinks)
r A good fall back on course/trip filler
NR Not recommended
This approach is more telling (it seems to me) and more useful (as a guide to someone like me) than the traditional numerically-based systems (e.g. Top 100) where each course gets a score and then is ranked accordingly -- and where the difference in the scores between the 1st and, say, 15th courses is very often equal to or even greater than the difference between *all* the other courses on the list combined.
(E.g. if No. 1 scores a 9.4. and No 15 a 7.8. -- a difference of 1.6 points -- it sure seems that between No. 16 and No 50 you'll find the same 1.6 point/score difference.)
Now, this is not to disparage those lists or even the 'criteria' involved in rating courses (we've already done that endlessly and ad nauseam -- and I very much enjoyed Ben's Michigan list and Brian's Ohio list, especially the write-ups). Instead it's to note:
a) that, while like Sean's approach these kinds of lists do very well at highlighting the best of the best (about 10%), unlike Sean's list they do a relatively poor job of guiding a would-be traveler on deciding which course among the remaining 90% (presumably all good-to-very-good courses) is appreciably better or more interesting than any other; and to note
b) that this difference between the two approaches suggests something important about the topic at hand, i.e. how we evaluate golf courses
What it suggests is that the decades-long approach to course evaluation (ie one that consciously or not uses the same basic approach/set of expectations for every single course being evaluated) has led to the vast majority of (even very good) golf courses being virtually indistinguishable in terms of quality and interest.
I wonder what the potential impact might've been on gca if, 60 years ago, the magazines and the rest of us had adopted the Arble Scale, which seems to preference *uniqueness* and *exceptional quality* above all else. There wouldn't have been much place to hide, or even much room for nuance for any new course that was built:
Golfers might plan an entire trip (and pay for an overnight stay) simply to play course X; or they might make a long drive to play it; or they might skip it all together! That would've gotten one’s attention...