Let's look at some history of past rater's notebooks and how close the subsequent panelist scores were to Brad's initial assessment. It doesn't look like there is much correlation, though psychologically you'd think that at least some panelists would be motivated to conform to avoid the risk of being an ex-panelist. Golf Digest seems to have this issue as well with its Dean Knuth outlier grades.
Chambers Bay (Jun 2007): 8.5-9.0
http://golfweek.com/news/2007/jun/16/raters-notebook-chambers-bay/?RatersNotebook"A stunning technical achievement, one that appears entirely natural, Chambers Bay clearly rates among Golfweek’s Best top 50 Modern Courses (post 1960). It is a fitting culmination to Robert Trent Jones Jr.’s design career, as well as an impressive achievement for design associates Bruce Charlton and Jay Blasi."
22. Chambers Bay Golf Club 7.76
(25, d) University Place, Wash.
2007, Robert Trent Jones Jr., Bruce Charlton
The Club at Irish Creek (Jan 2008) 7.0
http://golfweek.com/news/2008/jan/12/raters-notebook-irish-creek/?RatersNotebook"A strong candidate for Golfweek’s Best Top 100 Modern status and clearly the best work produced by Love Golf Design."
200. (NR) The GC at Irish Creek
Kannapolis, N.C., 2007
Davis Love III
Real Estate, Private
6.45
Fallen Oak 8.5
http://golfweek.com/news/2009/jul/11/raters-notebook-fallen-oak/?RatersNotebook"Fallen Oak debuted on the 2009 Golfweek’s Best modern list at No. 55 and arguably is underrated there; it certainly is among the top 3 of the 40-plus Fazio courses I’ve ever played."
48. Fallen Oak Golf Club 7.30 (it had 7.03 in 2009)
(45, r) Saucier, Miss.
2006, Tom Fazio
TPC San Antonio (Nov 2009) 6.5
http://golfweek.com/news/2009/nov/30/raters-notebook-tpc-san-antonio/?RatersNotebook"One of Norman’s best designs in terms of overall playability and among the least contrived of the TPC network courses. Deserves a serious rating among top 100 resort courses."
57 (Best Resort). TPC San Antonio (AT&T Oaks)
San Antonio, Texas, 2010
Greg Norman
Avg. rating: 6.14
Mayakoba (Mar-2010) 8
http://golfweek.com/news/2010/mar/04/whole-new-yucatan/?RatersNotebook"There’s a reason the Golfweek’s Best rating team voted Mayakoba’s El Camaleon the No. 7 layout in all of the Caribbean and Mexico. It’s far and away the most compelling and most relaxing of the 17 Norman-designed courses I’ve played."
19 (Caribbean/Mexico). Mayakoba (El Camaleon) [was 7th, 12th and 20th in 2010-2012 respectively]
Maya Riviera, Mexico, 2006
Greg Norman
Avg. rating: 6.63
Corales (Apr-2010) 8
http://golfweek.com/news/2010/apr/05/corales-golf-club-overwhelms-senses/?RatersNotebook"The result is a fanciful collaboration of color, texture and natural landforms in a light-saturated Impressionist idiom that is unlike anything else in the Caribbean."
12 (Caribbean/Mexico). Corales Golf Club [was 6th and 9th 20th in 2010-2011 respectively]
Punta Cana, Dominican Republic, 2010
Tom Fazio
Avg. rating: 6.92
The Patriot (Jun-2010) 8
http://golfweek.com/news/2010/jun/15/raters-notebook-patriot-golf-club/?RatersNotebook"Each hole is memorable yet integrated compositionally. It all makes for a moving experience symbolically as well as a fine test of golf. A strong contender for top-100 status on Golfweek’s Best Modern list."
42. Patriot Golf Club 7.34
(48, p) Owasso, Okla.
2010, Robert Trent Jones Jr.
Dove Mountain (Feb-2009) 6
http://golfweek.com/news/2009/feb/14/raters-notebook-dove-mountain/?RatersNotebook"Visually stunning and enjoyable, as long as you don’t care about greens in regulation or putting stats."
38 (Resort). Ritz-Carlton GC at Dove Mountain (Saguaro & Tortolita)
Marana, Ariz., 2009
Jack Nicklaus
Avg. rating: 6.41
Royal Isabela (May-2011)
http://golfweek.com/news/2011/may/09/raters-notebook-royal-isabela/?RatersNotebook"Luxurious, fun and weirdly compelling despite some modest flaws, Royal Isabela surely merits inclusion in the middle of Golfweek’s Best list of the top 50 courses in the Caribbean and Mexico."
39. Royal Isabela
Isabela, Puerto Rico, 2011
David Pfaff
Avg. rating: 5.90
Dismal River (Sep-2011) 6.6
http://golfweek.com/news/2011/sep/22/raters-notebook-dismal-river-mullen-neb/?RatersNotebook"Close to a top 100; certainly a top 200 Modern course. With its brazen feature work and starkly angular demands, it’s best thought of as Nicklaus’ version of Tobacco Road. The macho culture and furnishing of the clubhouse make Dismal River seem like a little frat house on the prairie – and many will love that."
196. (NR) Dismal River Club
Mullen, Neb., 2006
Jack Nicklaus
Private
6.46
Dormie Club (Dec-2011) 7.5
http://golfweek.com/news/2011/dec/01/dormie-club-worth-playing-nc-sandhills/?RatersNotebookImmediately falls in behind Pinehurst No. 2, and with Pine Needles and Tobacco Road, as among the area courses worth visiting and replaying.
78. *Dormie Club 7.02
(NR, p) West End, N.C.
2010, Bill Coore, Ben Crenshaw
Others:
Golf at Harbor Shores 5.0
Waldorf-Astoria 5.5
Coyote Springs 6.0
Old American 6.5