@edwiebe My understanding is that they are the output of convolutional neural networks. Of which I don't have a deep understanding, but I don't think the mechanisms are primarily statistical.
@timbray@edwiebe Which credible critic of LLMs is saying that they are "glorified Markov chains"? Haven't heard that. And they aren't convolutional neural networks. They're composed of multiple transformers which most certainly are not Markov chains but they are entirely statistical.
@twitskeptic@timbray@edwiebe It’s not really about “credible”, it’s more “loud” and “influential”. There are quite a few with long reach who have not bothered to find out how LLMs work but are quite happy holding forth about them.
@twitskeptic @timbray @edwiebe It’s not really about “credible”, it’s more “loud” and “influential”. There are quite a few with long reach who have not bothered to find out how LLMs work but are quite happy holding forth about them.