Question to other server admins who are using ElasticSearch!

How do you keep up with the growth of the ES database? Run extra servers, clean?

#mastodon #mastodev #mastoadmin

Follow

@snder Bigger and better servers. Its costing us several hundred a month to maintain that sort of capability.

@freemo

Oh wow.. That's a little over budget for me haha! quey is now running on a €20 server plus Wasabi costs..

I've had it running for a while but it eats up diskspace very fast.. :(

@snder Last month cost me about $600 and next month will come down to closer to $200 after i did some cost saving. Luckily we have over 10K in our funding coffers so we are good for a while.

@freemo

Holy shit man! Are you talking about the qoto instance now or any porjects? :o

@snder Thats Qoto, but keep in mind qoto is intending to be bigger than just a mastodon instance. The intention is to be a full ecosystem for engineering (software and hardware) solutions, specifically the collaboration side.

@freemo

I see, you're hosting more then only a mastodon instance! Also PeerTube and some other fun project I see ^^

May I ask how did you raise that much funds for qoto? :o

@snder peertube and similar were hosted but currently downa s we are revamping the whole ecosystem. But yea, thats just a tip of the iceburg for what is planned though.

The funds came from both myself and other investors who funded the project we are going to be chatting about. Qoto is one small non-profit component in the bigger picture there.

@freemo @snder

But still it's seem too much 🤔 200 USD even if you hosting Mastodon, PeerTube and Web clienta.

@inditoot

It's much indeed but still, look at all the hosted data?

@freemo

@snder @freemo

There are three project
Mastodon
Web client
PeerTube (that is down)

What data you are seeing other than this?

@inditoot
Our cost comes almost entierly from the masto side right now. Cost of indexing virtually the entire fediverse.

@snder

@inditoot
The cost is almost entierly due to a massive federation footprint on . We keep full federation history, index federated toots, and federate with the vast majority of the fediverse.
As a result the database for Masto alone is many terrabytes large and growing rather quickly. Takes a lot of processing power to index the entire fediverse.

@snder

@freemo @snder

Hmm A dedicated server cost around 50 USD additional drive can be added for 20 USD for 10TB.

How much you are paying for server and which host you are using?

Mastodon.host also host quite alot of project, it would be aweomse if someone ask gled about cost.

@inditoot @snder The server itself is 120$ its the large server, dedicated option through mastodon.host actually (he helps us on day-to-day maintenance, we modify the source ourself and do the testing ourselves).

Then there is about an extra $60 in backup and storage costs. We have multiple-redundant backup.

@freemo

Hmm.. wow! It still is a lot of money:O but I certainly like the setup❤️ If you want something done good and the right way it’s gone cost.

quey, Sinblr & pixfed combined costs me about €100 a month

@inditoot

@snder
If we reduced redundancy on backups and did not index the whole fediverse I could probably get it well below $100. But its important to me to make this a professional setup.

@inditoot

@freemo

Yeah totally! If I would have the funds I would also do it that way, I mean I can’t compare my setup against your professional one haha!

I just started about a half year ago with the setup of Mastodon, I had some experience with CLI but not much.. Luckily I’m a fast learner 🤓

@inditoot

@snder @freemo

You use S3 for media or local server?
And backup is complete backup including media or just Database?

@inditoot
We used to use S3for redundancy. Cost us 600$ a month total cost when we did that. We recently moved ourbackups which brought the price closer to 200$

@snder

@freemo @snder

Where you moved your backup? Sorry for asking too much questions but I also want a setup like your in near future

I recommend running a local server with alot of hard drive with raid setup this will help you alot in reducing the cost.

@inditoot
First line backup is wasabi. Then it will be disceminated back to S3 again but this time through a seperate server that will locally zip it first. This should eliminate the costs with S3 since we were backing it up without zipping first (we didnt want to load the server).

@snder

@freemo

That’s a smart line of defense! Clever to zip it indeed! What about remote media? Do you clean it or keep it and build an archive?

@inditoot

@snder
So far it is all being kept for robust and complete searches.

@inditoot

Show newer

@inditoot

S3 is for media, I also make backups with DigitalOcean, I manually backup the database, the .env and the redis db

@freemo

@freemo

Very nice 🙂 That's pretty cool all under the same roof and all that is needed. I've tried something similar with quey, PixFed and VideoFed but it was to expensive with not many Patrons unfort..

Oh man, can't wait to talk about this in person! So many possibilities!

If quey, sinblr or pixfed can do anything to help just let me know! 😎

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.