To be fair, that's a tradeoff many on that side are happy to accept.
I often hear conservatives talking about how "big business" takes advantage of "weak" immigration policies to lower wages in pursuit of profit, and they want to change that even if it means fewer workers.
(Their perspective, not mine.)