JES II:
The key courses would be covered -- in any given year you have a number of "must visit" courses and if someone occupying the key critic chair is really on top of their job they should easily be able to provide updates / assessments as needed. The likely number is closer to 50-75 courses.
In todays information age the key candidates would easily be seen / reviewed as needed. Frankly, the idea of the invisible fishing hole that produces quality fish is long gone because of today's 24/7 information age we live.
George:
Now finally there is a position you stated that I can agree upon.
Huck said:
"I also think the potential for ass-kissing him and thus overly influencing his opinion would be HUGE. Do you also so quickly give up the ANONYMOUS part of Basic Reviewing 101?"
C'mon good buddy -- the reality is far different than you suggest. The ass-kissing / hand-holding routines are going on NOW fast and furious. With just one person or a select team of inside people from a publication you would likely have far less if any at all. Why?
The people doing this would access courses without briefing people as to their visit. Raters today make it a point to contact a facility IN ADVANCE before going -- particularly private clubs and the like. This sets in motion two things -- the facility then makes itself "available" for the rater and the opportunity to schmooze can be scheduled so that everything is handled as the host club wishes.
Blind visits work because no one -- accept for the person going -- knows when they will be there. You also detach all the pomp and circumstance that comes from having an official welcoming party and all the other non-related course agenda items.
The failure of ratings through consensus is that it simply throws different numbers together and often is nothing more than some sort of group assessment. I like the idea of one person -- warts and all -- because you would then get the kind of cross comparisons often neglected when the standing of a course is considered versus that of others of the same quality.