I have never considered this. It certainly isn't the reason I criticize Pebble Beach more than other places. I've criticized Augusta National just as much, but maybe you'll say that is also easy because I wouldn't assume I am ever going to play there again. I also called The National Golf Links of America "quirky" and the caddie master there still teases me about it to this day [but somehow I am still welcome].
Tom, there's a reason you're being invited to Augusta and you're probably not paying at Pebble anyway, and it's obviously not because you're some rater for
Golf. It's exceptionally admirable that pretty much everyone knows you're going to speak your mind the vast majority of the time. I suspect it is also pretty rare. My aside about Pebble isn't that
raters aren't able to give their honest opinion. It's that the diversity of opinion is necessarily limited by access.
The raters who play the most exclusionary courses are very probably not a random sampling of the pool of raters (much less golf enthusiasts). Suppose you have 15 or 20 raters that come play PV, and they end up rated #1. We don't then suggest that PV invites 20
new raters to come through the next year until all 100, 1000, or 10,000 raters (depending on the org) has played, right? I'm pretty skeptical that that would happen, but I honestly don't know.
If we have a limited number of raters come through, we should suspect that those ratings will by sticky. Combine that with the fact that folks who didn't love the course probably won't go though the effort to get back. Whereas someone who doesn't like Pebble might be able to swing by if they're in Monterey, because why not? Here, we've got and system that creates lopsided outcomes when access is restricted. Add in the fact that most rating orgs either "toss" or "investigate" statistical outliers, and you've got a system designed to create outcomes that look like group think.
Here, nothing nefarious need be happening, it's just that a chilling effect on criticism can show up as much in
selection bias as it can in folks genuinely holding their tongue to maintain good relationships. Folks who make the effort to return to an exclusive course probably already love it, and few will make that same effort to return to an exclusive course just to shit on it.