I agree with a lot of people that opt-out content mode of the Web is pretty amazing. The fact that you can publish content that is available to all, including bots, but that you can restrict those bots with an easy-to-edit robots.txt file, is actually remarkably cool. If you've ever used it, you'll know how effective it can be.

Follow

@evan @blake
Only well-behaved bots respect robots.txt. And the well-behaved bots aren't the problem.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.