Gendered nouns are incredibly difficult for non-native speakers (even if their native language contains gendered nouns) as they are completely arbitrary, just like the words themselves. So instead of remembering (word) a non-native now has to learn (gender, word) for every noun.

It's not the concept that is difficult, it's the extra piece of information that makes it more difficult.