Imagine this: if you were the white person in the room and someone goes " that white gal over there", referring to you and you heard yourself being referred to as such, would you like it?
Or say you were fat, not fat is a descriptive word. Would you say within hearing distance to the fat lady, “oh that fat lady over there ordered that”, and she heard you describing her as fat. She wouldn’t like it, would she?
People just don’t want to come across as racist. But want to appear polite, just use the adjective in a non-derogatory manner. and you should be okay.