The real problem is #humans, not #AI.
"People are often irrational and behave in ways that contradict their values, and values can change over individual lifetimes and generations. After all, it’s not clear whose values we should have machines try to learn."
https://www.quantamagazine.org/what-does-it-mean-to-align-ai-with-human-values-20221213