@haverholm No you have it backwards.
This proves that the remote server does not decide whether you are allowed to do so.
Yes, this is a questionable decision of the engineering that underlies the Fediverse. This isn't a problem of Pixelated: If you don't like this behavior, then blame the authors of ActivityPub and maybe find a different platform that behaves the way you would prefer.
This is just how this platform was designed to operate, for better or worse. I think for worse, but here we are.