There's a bug in wireplumber 0.5.6 that's been busting my balls for the past month.
If anyone else is using Pipewire on a rolling distro and having audio disconnect/resetting issues, roll wireplumber back to 0.5.5 and your problems will disappear.
I hate computers.