Excellent example on the way LLMs works. During chess openings, they play coherently as these openings are available on the Internet, then later they produce garbage and hallucinations as they have no idea on how to play chess. They just play based following probability distribution.
RE: https://mastodon.social/@freakonometrics/114049508052794990