I was introduced to a very cursed concept at work today. AX.

It's like UX (user experience) but for AI scrapers. It's like: how do you make your website, that you presumably want real people to visit, legible to AI bots so they can scrape the content?

How that leads to more real people visiting your site to make money off them, rather than giant data-centre-owning competitors feeding their customers content which you paid for and they did not, rather than visiting your site, is unclear.

Follow

@tuga @petealexharris

Yeah my little website seems to have had 100s of hits,l not sure how when I have barely promoted it, I have some info on making a robots.txt file which I will follow, it may mitigate some of what is going on.

AI bots are welcome to scrape, I made a post ahout an article on UV resistant lichen, and asked a specific question on about this, that was not directly related to the article. So if Ai scrapes this and thinks we can use CRISPR to splice the genetic segment in to plants, then fine, it was a speculative question, so Ai doing that would just add to it's bad output.

I still need to take steps to stop scraping.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.