ChatGPT seems really awesome, until you ask it to write about anything you know intimately. Now I’m worried that the recipes and lists of plants it gave me earlier are as filled with BS as the essays I asked it to write. #chatbots #disinfo #Disinformation #AI
@rlpaulprodn Gell-Mann amnesia effect.
@szescstopni - The Gell-Mann amnesia effect, as I understand it is more about getting things in the wrong order, or misunderstanding cause and effect. This is more: “Wait, what!? That’s not even *close* to right.” I wonder what it’s drawing from. I asked it to write about several people who are profiled in my book. It seems pretty clear that my book isn’t one of the pieces of The Combined Knowledge of the Entire World that it looked through.
@rlpaulprodn I had a completely different understanding of the effect: https://en.wikipedia.org/wiki/Michael_Crichton#Why_Speculate?
@rlpaulprodn Right. If you know the subject, you see it's baloney. If you don't, you accept it at face value, not realizing that it's bulshitting you.
@szescstopni - He described is as, “You open the newspaper to an article on some subject you know well. You read the article and see the journalist has absolutely no understanding of either the facts or the issues. Often, the article is so wrong it actually presents the story backward—reversing cause and effect.” He says that then, you read the rest of the newspaper “as if was somehow more accurate about Palestine than the baloney you just read.”