I seriously don't understand how it's possible that I just see news story after news story that could have been made up by a group of undergrads I asked to imagine things that might obviously go wrong with generative AI. https://themarkup.org/news/2024/03/29/nycs-ai-chatbot-tells-businesses-to-break-the-law
@luis_in_brief @cfiesler in this case this wasn't even adversarial testing, just testing on the typical questions that might be expected