In a thread too old to reply to, I saw this by Miss Tiffany:
What do you mean by Garamond is too French to be universal? Is Univers too Swiss to be universal too?
That's a good question, and I didn't see a good answer, or even the standard answer, in the thread. Hrant did note that he thought of Helvetica as a 20th century typeface, not a particularly Swiss one.
Assuming that a truly Swiss typeface is not necessarily a kind of blackletter that goes well with cuckoo clocks, though, why is Garamond "French" if being originally designed in France isn't enough?
One school of typographic thought, at least, views Garamond as uniquely French and Bodoni as uniquely Italian, and so on, based on those typefaces working well with the letter frequency characteristics of their respective languages, as well as their having a long history of association with them.