Great question.
I've walked Pebble, PV & Merion at events and while I'd love to play all don't have the screaming desire to play them.
However, I've also walked Shinnecock, NGLA & Chicago golf and would jump on the plane in a sec if the chance arises.
Not sure I can articulate why the feeling is so different with these two categories.