All these people excited about how #ChatGPT can write correct and to some extent consistent fiction, and I'm just thinking "yeah but wow this is bland and cliched, I would never spend money or time to read this stuff."
Are there genres in which the most likely and obvious thing is what draws readers? I feel like even readers of things like "cozies" want a little novelty.
@pre
That's certainly part of it. But even the early AI Dungeon, when #OpenAI apparently gave them a temporary pass on the SFW filters, tended to be very cliched; it's just that some of the cliche situations were porn cliche situations.
Which isn't at all surprising; what any #llm does is, literally, find one of the most likely (i.e unsurprising) continuations.
@pre
Although, to be fair, I also remember the early days of AI Dungeon as having magical. I need to go back and read some of the stuff I wrote back then and see if it was really as cool as I remember...
@ceoln it's like fame schools. Bland bland bland. Tbh a lot of ai art is very bland but it depends whose doing it ;)
@penworks
Yep! I'm having great fun trying to get Midjourney to surprise me (with some success); the text LLMs (even NovelAI without censorship) seems not as good at it.
I've been wondering for awhile whether a diffusion-based text generator might be more interesting than these token-autoregressive ones. I think there are a few out there, but they haven't made headlines.
@ceoln that sounds like something I'd be interested in. Consumer content not just AI is based on a kind of homogenised genrefication so that recommender systems appear to be good but in fact everything is pushed through very narrow channels.
@penworks
This is a possibly-interesting paper:
https://arxiv.org/abs/2210.08933
The abstract says inter alia "an intriguing property of DiffuSeq is its high diversity during generation, which is desired in many Seq2Seq tasks".
@ceoln Yeah, as it exists it's a pretty shitty co-writer coz they've trained all the fun out of it to try and make it safe for work. It hates and avoids conflict and violence and struggle, which are all things you tend to want in your fiction.
Maybe it could do romance okay? Dunno. Never really read much of that.