Recently here has been a lot of excitement around this paper by Piantadosi claiming that Chomsky's approach to language is now refuted by large language models (https://lingbuzz.net/lingbuzz/007180). And I am quite sympathetic to this idea, so I decided to give it a read. But... am I the only only one to find this paper deeply flawed? (1/4)
From a conceptual point of view first: sometimes LLMs are considered "models", sometimes they are called "scientific theories", sometimes they even seem to be an instance above scientific theories as they can "search for theories in an unrestricted space". (2/4)
... but for me this example shows quite the opposite: chatGPT succesfully copies the syntactic structure of the sentence, but completely misses the point of its nonsense: some parts make sense, others don't... (4/4)
More basically, Piantadosi argues that LLMs can manipulate semantic content. As an illustration, he presents chatGPT's response when asked to generate new sentences like Chomsky's "colorless green ideas sleep furiously". (3/4)