Boris Steipe @boris_steipe@qoto.org
- Sentient Syllabus Project
- http://sentientsyllabus.org
- Sentient Syllabus Analyses
- https://sentientsyllabus.substack.com
Joined Nov 2022
Almost. Your boat got a sail 🙂
That's interesting - we know that ChatGPT tends to compose "Schrödinger Facts" (https://sentientsyllabus.substack.com/p/chatgpts-achilles-heel), but I would have thought that it should be pretty straightforward to fix that by intersecting its statements with sources. As you noticed, getting that right seems to take more than just putting keywords into a Bing search.
Thanks!
Boris Steipe
boosted
Has anybody else noticed & pointed out that one of Bing's new #ChatGPT demos that actually includes citations is lying as to what that sources say?
This is the sample prompt we get for "summary" - about Roman history for a 10 year old.
It links to sources for specific claims.
Yet when I look up many of these claims on those pages... they aren't there.
Thanks - that's indeed well written and Lance Eaton raises many good questions; I particularly like that he thinks of concrete policy for the classroom.
You might be interested in the analyses over at the Sentient Syllabus project https://sentientsyllabus.substack.com where I also aim for a principled perspective on the many questions.
Boris Steipe
boosted
There's a lot to digest in this post, but I want to highlight the section on Lance Eaton's development plan (Temporary Policy, Sharing it with students, Sharing it with faculty) for preparing to craft policy/approach to ChatGPT with the help of his students and the What's Next? webinars... #ChatGPT #HigherEd #HigherEducation #Academia #CollegeStudents #UniversityStudents #Learnin #Education #Policy #Ethics #AcademicIntegrity #AcademicDishonesty #InstitutionalPolicy https://www.byanyothernerd.com/2023/01/chatgpt-ai-generative-tools-and.html
Boris Steipe
boosted
Going to watch Google present "Bard" #AI #Google #ChatGPT #LLM https://www.youtube.com/live/yLWXJ22LUEc?feature=share
Boris Steipe
boosted
"A boat sailing on an ocean while birds fly across the sun peeking through clouds in the background"
Rectangles, lines and arcs on <canvas>
ChatGPT 2023
This is very cool - and surprisingly pleasing. Also thanks for posting the JSfiddle with the conversation and the code!
I did notice that you had broken up the creation into parts initially, and I wondered to what degree the model would be able to independently parse the objects and define their relative location. So I asked it to create svg code directly from the your prompt. I put the result into an html wrapper since, I had to add a light blue background, otherwise the white clouds would have been invisible. Here is the full html including the prompt:
<html>
<head>
<style> body { background-color: #E9F0FF; } </style>
</head>
<body>
<!-- Prompt: Please write the code for an svg that shows the following scene: "A boat sailing on an ocean while birds fly across the sun peeking through clouds in the background". -->
<svg width="500" height="500">
<!-- Background with ocean -->
<rect x="0" y="400" width="500" height="100" fill="#0077be"/>
<!-- Boat -->
<polygon points="250,450 200,400 300,400" fill="#ffa500"/>
<rect x="225" y="400" width="50" height="50" fill="#ffa500"/>
<!-- Sun -->
<circle cx="70" cy="70" r="40" fill="#ffd700"/>
<!-- Clouds -->
<path d="M100,100 Q120,80 140,100 Q160,80 180,100 Q200,80 220,100" fill="#ffffff"/>
<path d="M180,50 Q200,30 220,50 Q240,30 260,50 Q280,30 300,50" fill="#ffffff"/>
<!-- Birds -->
<path d="M120,110 Q140,120 140,140 Q140,160 120,150 L110,140 Q100,120 100,140 Q100,160 110,150" fill="#000000"/>
<path d="M280,110 Q300,120 300,140 Q300,160 280,150 L270,140 Q260,120 260,140 Q260,160 270,150" fill="#000000"/>
</svg>
</body>
</html>
They know
Leo Szilard, one of the nuclear physicists who raised their voice against the atomic bomb, formulated such ten commandments for the modern world in 1961.
My favourite one of those is number four: "Do not destroy what you cannot create." It is for me to this day the single most memorable thought that shaped my views on sustainability and the need to protect the environment when I was a student.
@emma
Emma - while reading Crawford and Paglen's essay that you posted and looking into some of the background, I came across a rebuttal by Michael Lyons (2021), one of the creators of the JAFFE dataset, refuting in detail Crawford and Paglen's assertions and pointing out significant ethical problems with their practice.
https://hal.science/hal-03321964/document
This is very concerning.
Trying to get the issue of academic misconduct right leads to a lot questioning.
I just posted an analysis on generated (AI) writing over at #SentientSyllabus:
https://sentientsyllabus.substack.com/p/generated-misconduct
Mey key point is that we need a principled and deep understanding of academic integrity, and that can be provided by a commitment to truth. Accordingly the source of misconduct is "deceit", and not the nature of the text itself. We need to keep in mind however, that we are unlikely to be able to detect all such deceit. Therefore we need to build a collaborative framework of education. Creating an academic work ought to be as enjoyable as writing your own diary.
#ChatGPT #AI #Education #HigherEd #University #Academia #AcademicIntegrity
Boris Steipe
boosted
ChatGPT's Responses to Ten Unanswerable Questions https://bit.ly/3HW6X1l #ChatGPT #philosophy #religion
Boris Steipe
boosted
Informative Linksammlung zum Einsatz von ChatGPT in der Hochschullehre
We expect authors' transparency "to what extent" AI technologies were used. In my analysis I proposed some qualitative language, but whether that is enough transparency can be questioned. It would not make the actual flow of ideas explicit or verifiable - that is what I mean by "documenting process"; a small point, but central to the debate.
In the absence of verifiability, all we have is trust.
Realizing that has its own implications.
🙂
"[...] on the ScienceQA benchmark and even surpasses
human performance."
It is hard to escape the feeling that we are in a phase of "accelerating returns", the kind of exponential dynamics that Kurzweil has been speaking of.
Thanks!
Boris Steipe
boosted
GPT 3.5 is already a fossil. This does a significantly better job with less compute: Multimodal Chain-of-Thought Reasoning in Language Models
Boris Steipe
boosted
We're in Nature with an opinion piece on how researchers should respond to #ChatGPT and conversational AI technology more generally!
It's been an interesting experience to reach consensus in an interdisciplinary team of scholars (2 psychologists, 1 computer scientist, 1 philosopher and me, an NLP-er).
We list 5 priorities:
1. Hold on to human verification
2. Develop rules for accountability
3. Invest in truly open LLMs
4. Embrace the benefits of AI
5. Widen the debate
Great work. Thank you!
You are spot on where you write: "This defies today’s binary definitions of authorship, plagiarism and sources, in which someone is either an author, or not, and a source has either been used, or not. Policies will have to adapt, but full transparency will always be key."
I think this continuum applies to the question of accountability as well (I developed that a bit here: https://sentientsyllabus.substack.com/p/silicone-coauthors ). There, I propose to leave the decision of co-authorship to the authors. It is certainly not deceptive to do that, which distinguishes it from gift-, ghost-, and guest-authorship. Transparency is key.
An unresolved implication is a desire to document process. That would be great, but adding another _dimension_ (progress) to linear text is conceptually difficult and I am not aware of technical approaches.
Your proposal for non-profit LLMs is interesting, but will ultimately run up against the same concerns as private sector LLMs - simply due to the need of significant funding for training and operation. An alternative might be public LLMs, modelled on our public library systems. I have not seen that discussed yet. Certainly very doable at EU scale.
Thank you for this contribution.
Boris Steipe
boosted
Ich kann mich nicht erinnern, dass ein neues digitales Tool so schnell von Schüler:innen und Lehrer:innen wahrgenommen und getestet und besprochen wurde, wie das bei #chatGPT gerade passiert.
Zwar gehe ich nicht davon aus, dass genau _dieses_ Tool alles verändern wird, aber es steht für ein neues Konzept, dessen disruptives Potential sehr schnell einleuchtet. Dieses _Konzept_ (Nutzung von Sprachmodellen für die Erstellung von Texten, das Programmieren etc.) ist das eigentlich Spannende.#fedilz
- Sentient Syllabus Project
- http://sentientsyllabus.org
- Sentient Syllabus Analyses
- https://sentientsyllabus.substack.com
Joined Nov 2022
