I found the problem discussed together with this similar, but probably unrelated issue:
https://github.com/vedang/pdf-tools/issues/112
According to the discussion, the culprit is #poppler, and the problem should go away with a newer version. I’ve just updated poppler to 23.01.0, we’ll see how it goes…