So, reading through today's "ai" horror story - link below, it's where this SaaS dude has been vibe coding and let a product called "Replit" have access to prod and apparently delete it - there's something -very- striking that's stood out to me.
The guy asks the 'ai' for what "he" - note the wholly inappropriate anthropomorphization - had done and why.
And then trusts the response.
Now, not to put too fine a point on it, but this is in a context where the human involved has notated -multiple- times that the damn fool thing had made shit up wholesale multiple times.
Why in the fuck did he - the person; I refuse to assign a gender to a machine - trust the LLM's output instead of having transaction logging enabled to audit the actions that the machine had made on the systems in question?
This is some very fucking basic SDLC practice shit that apparently they have failed to implement.
LLM usage rots people's brains, and this is yet more evidence of that.
Was he aware of the options? Was he able to do something other than trust the LLM about any sort of isolation being set up correctly?
I suspect that the answer is no, because otherwise it's hard to believe him not thinking about that for days.
