The argument is that the states will lose funding as they make money through tax policies and loan servicing operations. Should the loans be forgiven, they will lose those revenues and take a hit to their budgets.
The lower court agreed with this, finding that the budgetary harm would give them standing.