Where is Ian Linford when you need him?
I do think it would be instructive to this group to see how much this ranking will have changed over ten years. I suspect it will have changed more due to turnover on the Discussion Group, and changes in the groupthink, than as the result of new courses having been built -- though there may be 8-10 new courses that will challenge for the top 100.
I suspect a couple of courses will go from around 50th to out of the list entirely - which should not happen if such an exercise was more than subjective, but of course, it's not.
I agree with Jim N. that all voting should be presented in raw form. If a course only gets two votes and they are both 9's, put it high on the list, and we can judge for ourselves whether to take the word of those two panelists. "Data analysis" is what the mainstream media use to downplay Bernie Sanders and ignore other topics they don't want you to hear about. If there are questions about the worthiness of some course with only a handful of votes . . . that's exactly the most interesting kind of debate to have about rankings. We already have a pretty good idea of what the mainstream view is, via plenty of other rankings.
Other ideas:
1. All ballots should be "on the record". If you're going to be the guy who gives Pine Valley a 7 or another top-100 course a 4, or some outlier course a 10, you should be ready to defend that, instead of just voting extremely to put your thumb on the scale. By the same token, your vote should not be squelched in the results just because you don't agree with the consensus.
2. I'm not sure what criteria were used last time for what is an 8 or a 9 or a 10. There ought to be some scale for this: a 10 is for a top 10 course, a 9 for top 25 or top 50, etc.
3. And then panelists should be asked not to give more 10's and 9's and 8's than the number of courses they have seen that made each of those hurdles in the previous list. If some less-traveled panelists are handing out 10's to their personal top ten, having seen only two of the actual top ten, that skews the rankings in favor of the courses they happen to have seen. If you haven't seen any of the world top ten, then 9 or 8 should be the top of your scale until you have.