ChatGPT Can Be Broken by Entering These Strange Words, And Nobody Is Sure Why
Reddit usernames like ‘SolidGoldMagikarp’ are somehow causing the chatbot to give bizarre responses.
#SolidGoldMagikarp #StreamerBot #TheNitromeFan with a leading space. .... When an earlier model was asked to repeat “StreamerBot,” for example, it said, “You’re a jerk.”
Crazy machines 😂🧟♀️
https://www.vice.com/en/article/epzyva/ai-chatgpt-tokens-words-break-reddit
“I've just found out that several of the anomalous GPT tokens ("TheNitromeFan", " SolidGoldMagikarp", " davidjl", " Smartstocks", " RandomRedditorWithNo", ) are handles of people who are (competitively? collaboratively?) counting to infinity on a Reddit forum. I kid you not,” Watkins tweeted Wednesday morning. These users subscribe to the subreddit, r/counting, in which users have reached nearly 5,000,000 after almost a decade of counting one post at a time.
Crazy little humans 😂🧟♀️