@publicvoit if you have the older Emacs installed too, the profiler might show what used to be not slow. Running without packages (no-init) might be faster, just to check.
This happens to me too, and it doesn't make sense and eats up time (worth it, for the features). The dependency stack and compilation flags too might be making the difference (NixOS).