I guess culture is the main point - if you live in China, you probably get better at telling apart Chinese faces. And vice versa - I can only guess that telling apart western faces might be hard for people from other cultures, too. I should add that I live in Europe, I think in the US there is a higher mix of people from different backgrounds, so my example is perhaps not as convincing.