Hey gents:
Having participated (and continuing to...) in rating and rankings, I have a couple of observations. I've done a dozen or so evaluations of local Toronto coures for a magazine that paid all my expenses -- I simply booked a time and played the course. It meant I saw a range of courses (though most of them were poorly kept and uninspiring). I've also participated - and continue to do so - on one US panel and two in Canada.
The reality is that rankings and rating are different. For rankings, like GD's best new list, paying is often not an option and arriving unannounced is nearly impossible. Private coures, for example, require an introduction, a letter, or a call, often weeks in advance. Generally these esteemed private courses don't appear in "ratings," only ranking lists.
Does it make a difference whether one pays a greens fee? I don't see where paying has a large impact. For example, I recently paid to play Carnoustie, but received an invite to play St. George's (in Toronto) for free. Did I evaluate the courses (admittedly great ones) differently because I paid for one and didn't pay for the other? I don't think so. And if a ranker is showing up to a "best new" in order to conduct an evaluation, do you think the club can make any changes to the course regardless of whether the gree fee is comped or not? It is the same course -- regardless of whether someone pays or not. Good or bad -- paid or free.
The reality is that GD says, in its code of conduct, that rankers should expect to pay a green fee. There is even a list of things they can and cannot receive for free -- ie. green fee, OK, golf hat, not OK. I've been asked to pay on at least a couple of occasions.
As for travel writing, that is a different matter. The economic reality of travel writing for the last two decades, at the very least, has meant that travel writers almost never pay for anything. None of the publications that print their material could afford to exist if they paid for trips. There are some exceptions -- but they are usually news letters that have high subscription fees.
What I've found, as a writer, is that you can be critical in travel writing. First, say what you liked and didn't like -- I tend to and still get offered more "fam" trips than I can take. Secondly, when reading stories, often courses are left out -- it is the way travel writers often indicate what they didn't like.
Anyway, that's enough of me.... I tried to avoid wading into this one...
Robert