Well, a lot! Especially women when most courses effectively have a "NO GURLZ ALLOWED" sign at the door.
I have a few instances where I have courses close to each other, and as far as I can tell, the harder course gets attention the first few years, but golfers start drifting to the one where they lose fewer golf balls over time. Of course, service, price, value, etc. also factor in.
As to the fuss, they may understand some of the factors, i.e., native areas dictated by irrigation restrictions, wetlands preserved by regulation, etc. My dad always said the best customers are the ones who tell you what is wrong, but most just walk away and never come back. I think many course managers try to minimize the difficulty on weekends, by putting tees up and pins in accessible and flat locations. The golf course I worked at decades ago always mowed the rough on Fridays, as well as probably Tuesday, but Friday to ensure it was as short as it could be.
I would be crucified by this group of GCA fans, but a lot of reasons that go into, say, placing bunkers start with decisions, based on painful experience, as to where NOT to put them, either because they block cart traffic, see too much play (i.e., front right of greens, or even bunkers extending too far forward from greens, etc.) The USGA has a program now where they attach GPS to your golf carts so you can see where golfers actually go. Using data, I have been plotting out the likely landing zone limits of average and below players, using the 66% of the USGA Slope method for hitting greens, 75-80% of D players for corridor width (figuring you really don't want more than one in four D players looking for balls on every hole, and frankly, 1 in 8 or every other foursome would be better, if possible), that same 1 in 8, or 92% on course safety zones, and up to 99% for off course safety zones.)
But, I digress. I always wondered why the USGA used 66% instead of 75%, but when you run the math, for D players, attaining 75% hit rate for greens or fairways is nearly impossible, barring owning a good size cattle ranch, LOL. That said, so many courses bring in the LZ to save a row of sprinklers, but in the process maybe costing themselves much slower play.