I don't think that framing of the argument captures it.
I hear Republicans constantly talking about ID other than passports. Heck, I get the impression Republicans are generally skeptical of passports themselves.
And everyone is similarly impacted? There's a common thread in Republican mindsets that similar impact is emphatically not important. They constantly talk about equality of opportunity above equality of outcome.