Great topic!
Pre coffee I am not thinking of any "great buildings" but from my experience, the clubhouse at Shady Oaks in FtWorth sits close behind the 9th green, with Hogan often sitting by the window until his death. I had a bunker shot once, with him watching, and all I could imagine was the morning headlines had I somehow skulled it and broken the window in front of him.....the opposite happened, of course, with a weak shot I left in the bunker.
One of my very early rounds of golf was at a little par 3 course at a hotel near O'Hare airport (NLE) where I almost had a hole in one after hitting a bank shot off the exit door at the end of the hall......and nearly missing and exiting guest.
At an ASGCA meeting once I played with an architect occaisionally discussed here who sliced two OB right on 18, causing the commotion TD mentions. He then aimed way left, but double crossed it and hit it OB over 1 fw from 18 tee. The caddy says "I never saw that before.....but then, I have only worked here for 45 years!"