Question to other server admins who are using ElasticSearch!

How do you keep up with the growth of the ES database? Run extra servers, clean?

#mastodon #mastodev #mastoadmin

@snder Bigger and better servers. Its costing us several hundred a month to maintain that sort of capability.

@freemo

Oh wow.. That's a little over budget for me haha! quey is now running on a €20 server plus Wasabi costs..

I've had it running for a while but it eats up diskspace very fast.. :(

@snder Last month cost me about $600 and next month will come down to closer to $200 after i did some cost saving. Luckily we have over 10K in our funding coffers so we are good for a while.

@freemo

Holy shit man! Are you talking about the qoto instance now or any porjects? :o

@snder Thats Qoto, but keep in mind qoto is intending to be bigger than just a mastodon instance. The intention is to be a full ecosystem for engineering (software and hardware) solutions, specifically the collaboration side.

@freemo

I see, you're hosting more then only a mastodon instance! Also PeerTube and some other fun project I see ^^

May I ask how did you raise that much funds for qoto? :o

@snder peertube and similar were hosted but currently downa s we are revamping the whole ecosystem. But yea, thats just a tip of the iceburg for what is planned though.

The funds came from both myself and other investors who funded the project we are going to be chatting about. Qoto is one small non-profit component in the bigger picture there.

@freemo @snder

But still it's seem too much 🤔 200 USD even if you hosting Mastodon, PeerTube and Web clienta.

@inditoot
The cost is almost entierly due to a massive federation footprint on #QOTO. We keep full federation history, index federated toots, and federate with the vast majority of the fediverse.
As a result the database for Masto alone is many terrabytes large and growing rather quickly. Takes a lot of processing power to index the entire fediverse.

@snder

@freemo @snder

Hmm A dedicated server cost around 50 USD additional drive can be added for 20 USD for 10TB.

How much you are paying for server and which host you are using?

Mastodon.host also host quite alot of project, it would be aweomse if someone ask gled about cost.

@inditoot @snder The server itself is 120$ its the large server, dedicated option through mastodon.host actually (he helps us on day-to-day maintenance, we modify the source ourself and do the testing ourselves).

Then there is about an extra $60 in backup and storage costs. We have multiple-redundant backup.

@freemo

Hmm.. wow! It still is a lot of money:O but I certainly like the setup❤️ If you want something done good and the right way it’s gone cost.

quey, Sinblr & pixfed combined costs me about €100 a month

@inditoot

@snder
If we reduced redundancy on backups and did not index the whole fediverse I could probably get it well below $100. But its important to me to make this a professional setup.

@inditoot