Follow
"First thing to do is check robots.txt and see if this is allowed."
Probably not a subtle dig at the people DDoSing like 90% of the internet to scrape training data right now, but it should be 😛
"First thing to do is check robots.txt and see if this is allowed."
Probably not a subtle dig at the people DDoSing like 90% of the internet to scrape training data right now, but it should be 😛
@pganssle Similar attempts have been made in the past to enforce good behavior, but with little success