One way people look at it is that the revenues being given up through forgiveness will have to be made up by other taxpayers. That's a common way to think about this sort of thing in the US.
In that sense, yes, those who paid off their loans are losers as they'll have to pay more while not receiving the benefit of forgiveness.