David,
Other than his grandiose plans for the railroad on Long Island, his real estate dealings that some feel cheated an Indian tribe from their land, his extreme prejudice against Jews to the extent that he wouldn't allow any in his buildings...
I'm still trying to find where and how he influenced golf...