#norobots

@ken_fallon @hpr @methoddan @Edent @webmink @perloid @garythewilliams

The chat about "grabbing comments" at the start is quite interesting. I don't know if you know already, but it is common for people who don't want their comments archived to have #noarchive (or #noindex, or #norobots) in their bio. Nothing is a surefire protection, since what they want is not very coherent (they kind of want you to read their mind) - but accounting for that tag at least gives people an opt-out.