I can't reproduce this claim. You reposted someones blog who claims that #ChatGPT fails at cryptic crossword puzzles. But when I try the exact same question with ChatGPT-4, I get the exact correct answers. (Which surprises me quite a bit because I myself would not have been able to come up with the solutions.)
Dialogue here:
-----------
Human:
I would like you to act as a cryptic crossword puzzle solver. I will give you a clue and the number of letters in parentheses. You provide the answer as a single word with the required length. You also explain the reasoning. Please confirm, then I will give you the first prompt.
ChatGPT-4:
I confirm that I can help you solve cryptic crossword clues. Please provide the first clue and the number of letters in parentheses, and I'll do my best to solve it and explain the reasoning behind the solution.
Human:
Chap recalled skill: something frequently repeated (6).
ChatGPT-4:
The answer to the clue is "mantra."
Reasoning:
"Chap" suggests a man, which can be represented as "man."
"Recalled skill" hints at reversing a word meaning "skill," which is "art."
When we put "man" and the reversed "art" together, we get "mantra."
A mantra is something frequently repeated, fitting the definition provided in the clue.
Human:
Effect of legislation introduced by one politician (6).
ChatGPT-4:
The answer to the clue is "impact."
Reasoning:
"Effect of legislation" suggests we are looking for a word meaning "effect" or "influence."
"Introduced by one" hints at the Roman numeral "I" (which represents 1).
"Politician" can be abbreviated as "MP" (Member of Parliament).
Combining these elements, we get "I" (one) + "MP" (politician) + "act" (legislation) = "impact."
So, "impact" is the effect of legislation introduced by one politician.
Human:
Japanese food coming with S American greeting (5).
ChatGPT-4:
The answer to the clue is "sushi."
Reasoning:
"Japanese food" suggests we are looking for a Japanese dish, like "sushi."
"Coming with" indicates that we need to combine words or abbreviations.
"S American greeting" can be understood as the Spanish greeting "hola," which is commonly used in South America.
To derive "sushi" from these elements, take the first two letters of "hola" (ho) and insert them into the word "sushi": s + ho + ushi = sushi.
--------------------------
Note that the last answer is correct, even though the reasoning is not correct. I suspect that the clue that I copied from the blog contained an error - probably the "S" is wrong. However some combination of probability and elimination operating over the tokens in (Sushi/ Ramen/ Kombu/ Natto/ Arame) gets the right solution.
I would not have expected that.
(Also, I wonder whether this maps to a real-world skill... ?)