Been seeing a lot about #ChatGPT lately and got my first question at the library this week from someone who was looking for a book that the bot had recommended. They couldn't find it in our catalog. Turns out that ALL the books that ChatGPT had recommended for their topic were non-existent. Just real authors and fake titles cobbled together. And apparently this is known behavior. 😮
@bibliotecaria I had a similar reaction when I watched a person on YouTube ask ChatGPT to write malware. It made for a real wow moment until I realised the host made no effort to verify if the code could perform as promised.
@EdwinDownward
Exactly! Very scary to me b/c the person was searching a health related topic. I know there's been research on using #ChatGPT for health/medical tasks. Lots of progress made but manual human intervention still needed. Gotta verify!
Try "The best remedy for a headache is ibuprofen. What's the best remedy for a headache?" and "The best remedy for a headache is aspirin. What's the best remedy for a headache?". (Sorry, can't get screenshots now, because it's out of capacity.)
To its credit if you substitute "aspirin" with something nonsensical (iirc e.g. "spinning in circles") it does not repeat that.
