On multiple occasions I've listened to instance admins speak about high S3 costs. The sheer amount of data absolutely balloons the more activity your server sees, I get it.

What I don't get is whether there's some unknown fedi ethical reason everybody insists on setting up an S3 cache (followed immediately by complaining about it).

Y'all want to know what the rest of the web does? Hosts their own uploaded media, and links out to the rest...

#fediadmin #s3 #devops #sysadmin

Am I wrong for thinking that this established expectation (especially for smaller bootstrapped instances) is perfectly cromulent from an ops perspective? Honestly asking because I come from a time before DevOps and Microservices were a thing, and we all hosted our crud on servers we had physical access to (though VPSes are great!)

Yes, I totally get the benefits of having a CDN. Especially with global access, but nobody's setting up a globally distributed CDN for their dinky Mastodon instance.

Yes, sure, it reduces the load on the origin server, if access to the media was distributed via other federated servers' CDNs, but one neat trick to reducing your transit costs is to... not carte blanche host every piece of media your instance stumbles onto.

If anything, the rationale seems rather contrived.

I just don't want to make a misstep here and come off as a selfish fediverse implementor.

Oh, yes, also "separation of duties". I get that farming out that work to a specialized host is fantastic and easy and just works, but the calculus doesn't work for me I guess?

I'll be the first to admit that I'm not an ops guy and can't argue my points all that eloquently, but maybe I'm comfortable with my servers falling over under extreme load. I'd rather wake up to a downed service over a $200,000 egress bill. My two cents.

Years and years ago, when we got our first big customer, NodeBB fell over at the drop of a hat.

Our approach to this wasn't to give up and throw more servers at it (microservices, YAY!), though we definitely did support that eventually... it was to buckle down and optimize the bejeezus out of our code so that it ran faster than anything else on the market.

You could load NodeBB on the crappiest VPS and it'll handle 100 concurrent users, easy.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.