I understand what you mean outside of the USA because I don’t think the issue is the same.

But 41.6 million African American people in the US is not two people. So if this population finds that phrase offensive then it should not continue to be used within the USA and used carefully outside of the US because of the possibility of causing offence.