Microsoft is really amping up the GPT AGI hype with some truly terrible papers. One recent paper ("Sparks of Artificial General Intelligence:
Early experiments with GPT-4" h/t @ct_bergstrom) has examples of what they consider to be evidence of "commonsense reasoning". Let's take a look! 1/
@ct_bergstrom This, of course, is a very old riddle where the answer depends on understanding how to avoid predator/prey combinations. One question is: did GPT4 reason about this or did it memorize the answer because it saw it during training? 3/
@ct_bergstrom I think the answer is clear. If you ask GPT4 how it arrived at the correct answer, it happily tells you that it's already familiar with the puzzle. 4/
Ah, but this is precisely why it only qualifies as "Sparks of Artificial General Intelligence”… it is “smart” enough to just copy the correct answer from the Internet, but not yet smart enough to lie to you about how it arrived at its answer! 😂
@PhilipMartin
@twitskeptic @ct_bergstrom
Also, a person would be able to infer that it was the edible corn based on context, i.e., that you need to figure out how to get the "corns" across the river which wouldn't be much of a puzzle if the corns were attached to Bob's feet, unless they thought that the puzzle itself was a trick puzzle and the correct answer actually was the skin kind of corns.
It would be interesting to see what an LLM would do if it knew nothing about the puzzle in the first place and had to rely only on the context that it was given.
FYI, I thought maybe it was a grammatical error and I wanted to check myself if "corns" was a regional usage so I looked up "corns" on Google. I couldn't find it because Google only gave me ads for curing corns on your feet and such, plus answers for "corn". Google's response reminded me about the skin type of corn which prompted my response here.
@PhilipMartin @twitskeptic @ct_bergstrom
Here's a quote I found using the word "corns" in a grammatically correct sentence when referring to the edible corn.
"...sweet corns are widely distributed in western Mexico..." (referring to varieties of corn.)
Does anyone know if there is an English region where "corns" is used to refer to the edible corn?
@Pat @twitskeptic @ct_bergstrom
I always thought “corn” was one of those ‘non-numerated’ words, like fish, cattle, rice, or wheat… ‘could be one, could be a million… who knows?!?’
@Pat @PhilipMartin @twitskeptic @ct_bergstrom It’s an uncountable noun, so “corns” would be referring to different varieties of corn, not a pile of corn grains. Just like fish. Also a mass/uncountable noun, so the plural is fish. Unless you’re talking about multiple different species and then you use the word fishes.
@PhilipMartin @twitskeptic @ct_bergstrom
I found a source that said it's an uncountable noun but I'm pretty sure that's incorrect. I believe it's a mass noun like "furniture".