My interpretation is that the grandparent either has poor English skills himself, or is describing the difficulty of socializing with people who have poor English skills.