Total bandwidth spend on the website curl.se over the last 30 days? 71.94 TB
Distributed over an average of 3.44K requests per second.
@bagder how many of those using the curl useragent?
@pancake @bagder Probably GenAI scraping, this might help: https://github.com/TecharoHQ/anubis
QOTO: Question Others to Teach Ourselves An inclusive, Academic Freedom, instance All cultures welcome. Hate speech and harassment strictly forbidden.