For Section 230 purposes, is AI generated text third party or first party content? If a site sets up basically unsupervised or algorithmically supervised routine publication of #ChatGPT content, is it under current US law liable for what the robot says? Would OpenAI be? Would anyone at all be? (inspired by @emilymbender https://dair-community.social/@emilymbender/109716249225156006, though she presents a more traditionally publication-like, so arguably more likely liable, case.) #Section230

@interfluidity @emilymbender The algorithm isn't a person. So, if a person at the organization posts the algorithm's content, it's first party. But if someone outside the organization posts it, it's third party.

We need to avoid the temptation to assign agency to these tools.

@LouisIngenthron @emilymbender if a corporation posts something, it’s a 1st party but it’s not a person. is OpenAI the 1st party? The intent of Section 230 was to encourage a diverse range of internet forums, in terms of particip8n and moder8n. Section 230 shields even when in practical terms there is no 1st party to hold responsible, e.g. anonymous speech. AI tools are arguably an important new participant in online forums. should they be uniquely perilous?

@interfluidity @emilymbender OpenAI is every bit as much the first party as Microsoft Word is.

Humans (including human collectives like orgs) are responsible for our own actions. Our tools are not responsible for how we use them.

AI tools are not "participants" any more than video games are. Both are just entertaining output of human-designed algorithms.

@LouisIngenthron @emilymbender But AI language models are a form of human expression. Open AI is not the model. It’s the human organization that hired Kenyan workers to decide the model would be trained on this speech, not that, with this structure and these parameters, not those. That’s entirely unlike MS Word, which is neutral as to content. If anyone is to be responsible for Chat GPT speech, why shouldn’t it be the people who most determined its character?

@interfluidity @emilymbender That doesn't really matter.

You could use MS Word to write the Bible or Mein Kampf.
Likewise, ChatGPT can spit out something uplifting or something deeply racist, based on the prompt of the user.

The blacksmith should not be punished for the lunatic using his hammers to murder.

@LouisIngenthron @emilymbender But it’s not just the prompt of the user! MS has almost no role in determining the content of MS Word. Open AI typical has done much more than the prompter to determine what speech any particular prompt will yield. I prompt, “Say something jiggly” and it spits out a graf. Who more “authored” that, OpenAI or me (or nobody)?

@LouisIngenthron @emilymbender If you encounter a person’s speech, even anonymous, that is defamatory, and you pass it along by forwarding emails, usually you’d be protected by #Section230. (This is one of EFF’s disingenuous talking points in favor of Section 230.) What if it turns out the anonymous speaker was #ChatGPT. Are you still protected? Do we deem it the speech of the prompter, or Open AI, or whom?

@interfluidity @emilymbender It would be the speech of the prompter, the person using the tool.

@LouisIngenthron @emilymbender That’s an answer. I don’t think it’s necessarily wrong, but I don’t think it’s as clearly right as you do. We’ll have to collectively decide. It will come up soon, as orgs are publishing and conveying LLM outputs, and LLM outputs are very unpredictable. I’m bringing out the :popcorn: for how those controversies pan out. Both OpenAI and the prompter will argue that Section 230 means no one is accountable, just like anonymous speech.

@interfluidity @emilymbender I don't think the prompter will have an argument in that case. They chose to use the tool. They chose to write the prompt. They chose to publish the result. If the speech causes harm, their agency is at its root.

@LouisIngenthron @emilymbender It won’t look like that though. They will have build an algorithmic product that sends email or summarizes articles or whatever. No (prompter-side) human will have been in the loop, in products that would be uneconomical if one had to be. The argument will be the usual #Section230 claim: you’ll break the future you you make us take responsibility for this text we are conveying. 1/

@interfluidity @emilymbender That's still pretty simple: If there's no prompter on the client-side, then the server-side is just directly serving content they wrote and they'd therefore be liable.

@LouisIngenthron @emilymbender The prompter is the end user! User writes a question on a help forum, firm presents that to LLM OpenAI mostly trained but firm has customized. It replies to user. Is support-seeker author of the reply she receives, for “using the tool” that is the vendor’s support forum? Under your “prompter is author” theory, she would be! Is the firm responsible bc it customized the model? If so, why not OpenAI, whose training forms the bulk of it?

@interfluidity @emilymbender Our earlier hypothetical dealt with situations where the publisher and prompter were the same party (where I still stand by my old logic).

If the prompter and publisher are different parties, then I think the liability falls on the publisher for choosing to publish the bot's output as their own speech.

@LouisIngenthron @emilymbender These questions of who is the “prompter”, “publisher”, “creator”, “author” get very vague. A friend uses ChatGPT, gets a funny but defamatory response, forwards it to me privately by mail. I then publish it. Section 230 clearly protects me. Is my friend then liable?

@interfluidity @emilymbender I'm pretty sure S230 would not protect you in that situation, because, when you affirmatively made the decision to publish it, you became the first party. It does, however, protect the email system in hosting and delivering that speech to you.