Carl,
In general, I fall into the "anyone is qualified" camp. I might even qualify as the "intelligentsia" (any place but here, of course) but I really dislike the idea of "tastemakers" who sit around and discuss movies, restaurants, art, etc. as if they know more than everyone else.
You like what you like, and most people like it instinctively, regardless of any detailed point system. One example, is cresting the hill at the first tee of Crystal Downs a few years ago when TD invited me to play there. I knew from my first look it was one of the special places in golf and I doubt I could have changed my view using any point system after walking off the 18th green. (and frankly, if any great course could go downhill toward the end, its CD, with its personality Mac/Max split from front to back nine)
And I have no problem with large panels. The more opinions the merrier and they tend to average out where they should.