You'd get even weirder looks if you said "those persons travel a lot", while also sounding like someone who doesn't really speak the language.
"Those people" can be a racist or classist dog whistle, but isn't always, and also there isn't really an alternative. Say what you're going to say, and don't worry too much about it. The people who would misinterpret it to fit an agenda are probably going to do so regardless of what words you use.
But the Christfuckers we do have are obnoxious and loud enough to make you think otherwise