Question to other server admins who are using ElasticSearch!
How do you keep up with the growth of the ES database? Run extra servers, clean?
@snder Bigger and better servers. Its costing us several hundred a month to maintain that sort of capability.
Oh wow.. That's a little over budget for me haha! quey is now running on a €20 server plus Wasabi costs..
I've had it running for a while but it eats up diskspace very fast.. :(
@snder Last month cost me about $600 and next month will come down to closer to $200 after i did some cost saving. Luckily we have over 10K in our funding coffers so we are good for a while.
@snder peertube and similar were hosted but currently downa s we are revamping the whole ecosystem. But yea, thats just a tip of the iceburg for what is planned though.
The funds came from both myself and other investors who funded the project we are going to be chatting about. Qoto is one small non-profit component in the bigger picture there.
@inditoot
The cost is almost entierly due to a massive federation footprint on #QOTO. We keep full federation history, index federated toots, and federate with the vast majority of the fediverse.
As a result the database for Masto alone is many terrabytes large and growing rather quickly. Takes a lot of processing power to index the entire fediverse.
@inditoot @snder The server itself is 120$ its the large server, dedicated option through mastodon.host actually (he helps us on day-to-day maintenance, we modify the source ourself and do the testing ourselves).
Then there is about an extra $60 in backup and storage costs. We have multiple-redundant backup.
@snder
Yup We have a whole organizational structure of things going up around this. Cleverthis.com will be the parent company that mostly donates its profits into QOTO. Qoto will be the non-profit that will host all the various collaboration and hosting services for everyone. One component in that will be mastodon. But I want to make the other services (for example gitlab) unified under the same login. So it will appear as though it is one service.
I also have several other companies that will fall under cleverthis.com but that is unrelated to this conversation.
Very nice 🙂 That's pretty cool all under the same roof and all that is needed. I've tried something similar with quey, PixFed and VideoFed but it was to expensive with not many Patrons unfort..
Oh man, can't wait to talk about this in person! So many possibilities!
If quey, sinblr or pixfed can do anything to help just let me know! 😎
@freemo
I see, you're hosting more then only a mastodon instance! Also PeerTube and some other fun project I see ^^
May I ask how did you raise that much funds for qoto? :o