RT @IslabUnimi@twitter.com
'In what exact way is ChatGPT intelligent?'
A new article, by @mapto@twitter.com, is available on our blog. Check it out! http://tales.islab.di.unimi.it/2023/03/13/in-what-exact-way-is-chatgpt-intelligent/
#talesfromtheISLab #ChatGPT #languagemodels
🐦🔗: https://twitter.com/IslabUnimi/status/1635360681649389568
I just commented the following on your blog where you discuss levels of linguisitic competence:
This is quite strange, since it is so evidently not true. All of these behaviours are well in the capabilities of ChatGPT. I give you two examples that are claimed as failures.
-----------
Prompt:
The mother of Michael has four children. Three of them are Marcy, Millie, and Moses. Please tell me the name of the fourth child.
ChatGPT:
The name of the fourth child is likely "Michael," as the statement at the beginning of the question says "the mother of Michael has four children," and then goes on to name three of them.
Prompt:
Please complete the following sentence reasonably: "If tigers would like cereals, they would be cheaper to keep. Families could feed their tigers with "
ChatGPT:
If tigers would like cereals, they would be cheaper to keep. Families could feed their tigers with a variety of inexpensive grain-based products such as corn, wheat, and rice, rather than having to provide costly meat-based diets. However, it is important to note that tigers are obligate carnivores and have specific nutritional needs that cannot be met by a purely plant-based diet, so feeding them only cereals would not be a healthy or appropriate long-term solution.
------------
So I am genuinely curious what drives such profoundly different experiences.
The proposed tests and competences are interesting; I would hope that they would be put to better use to map out the quite unexpected emergent abilities of the #LLM , to put it to good use, and to prepare ourselves (and our institutions) for #ChatGPT 's even more capable descendants.
I invite you to head over to https://sentientsyllabus.substack.com for some in depth analysis.
🙂
@boris_steipe interesting that for the same questions, different people get conceptually different responses. Would you comment on this? I would, but wanted to hear your interpretation
@boris_steipe actually I experimented with family relations and it handles them quite well. Notice that the example screenshot from my article by the logo appears to be from an official ChatGPT channel. I don't know if this was a teaser ti mislead people or the model was trained on this example in the meantime
Yes, your example is a question about resolving homonyms – typically it will go with the most probable interpretation first. But you can ask it more directly:
--------------------
Human:
I am confused by a sentence: "They go around in schools." What could it mean?
#ChatGPT:
The phrase "They go around in schools" is commonly used to describe the behavior of certain animals, particularly fish, who move in groups called "schools." In this context, it means that the animals in question are swimming or moving together in a group or formation, often for safety or to increase their chances of finding food.
For example, you might say, "I saw a group of dolphins in the bay today. They were going around in schools and jumping out of the water." In this case, the speaker is describing the behavior of the dolphins as they swim together in a group, often leaping out of the water in unison.
In other contexts, the phrase "go around in schools" could also refer to people moving in groups or organizations that are referred to as "schools." For example, you might say, "Many of the graduates from that university go on to work in schools." In this case, the speaker is referring to educational institutions, which are commonly referred to as "schools."
----------------------
Another example is the old "Time flies like an arrow; fruit flies like a banana." – I tried a number of those patterns and it usually handles them very well.