The difference is not so much cultural as it is religious.
Predominantly Catholic countries don't have a golfing culture.
Look at France, Spain, Portugal, Italy, Poland, all of Latin America, hardly any golf at all, at least not among the native populations. Maybe being in church on Sunday mornings, and big family lunches, precludes golf.
The obvious exception, of course, is Ireland, where the overwhelming British influence has granted golf a solid foothold.