I seriously don't understand how it's possible that I just see news story after news story that could have been made up by a group of undergrads I asked to imagine things that might obviously go wrong with generative AI. https://themarkup.org/news/2024/03/29/nycs-ai-chatbot-tells-businesses-to-break-the-law
And you know what? The other thing that just utterly floors me is that AI systems are being released without doing the kind of basic adversarial testing that JOURNALISTS would immediately think of and be fully capable of doing.
@cfiesler bonus: then programmers (well, mostly their funders and execs) are offended when journalists do the adversarial testing. "How dare they! They must hate tech!"
@luis_in_brief @cfiesler in this case this wasn't even adversarial testing, just testing on the typical questions that might be expected
