Researchers at Apple come up with a generalisation of GSM8K benchmark that allows discerning how LLM's learn mathematics: whether they really do the maths, or just engage in rote learning
https://awful.systems/post/2610681