I've asked an 8-ball whether it's conscious. It told me "probably yes". That's how you sound when you do the same with a language model.