I agree with many on here that architecture/the course isn't the most important thing to me.
Choosing a club is a balancing act.
Location/access to the course is crucial. You can say that that 40 minute one-way drive is fine because the golf course is great, but what about when you don't have all day? Or you only have time for 9 or 13 holes after work? And how easy is it to get a time at the spur of the moment? There's a top club here that is pretty much wall-to-wall member and 3 guests every weekday afternoon. If you were a member there and wanted to get out because your afternoon meeting got cancelled, it might not be an option. Great club, but I wouldn't want to deal with that.
Cost, obviously, is a consideration. If the best club in your town is $40K to get into, but the third best club (which is still pretty good) is $5K or nothing to get into, that's a factor.
Family considerations. If you have a spouse and kids, what do they want? To many people, no pool is deal breaker. And you want the family to be happy because if they want to go out there and hang out, it gives you more of an opportunity to play golf.
Club vibe/membership. Is it a place with pretty much only BMWs, Mercedes and Lexus vehicles in the lot? Or are there some of those, but also some Toyotas and Hondas and an occasional mini-van? Where do your friends play? Is it a club where people like to gamble a lot? Is it laid back? Is it stuffy? Or are people welcoming? Is the staff nice? Or is the pro or GM a jerk?
Every person has to answer those questions for themselves, but I think there are plenty of things that can trump the course design alone. You could choose a club based only on course design and everything could turn out just fine. Or you could choose based only on course design and it might not be that great.