๐ณ๐ฑ
If an instance like hubzilla doesnt allow individuals to opt-out then the sys admin still has the ability to opt-in or opt-out the entire server. The users know about that. I agree it is unfair to the users they dont have the power to control that, but the fault lies with the hubzilla developers, not with fedisearch.
I assume by verified opt-in you mean someone going to fedisearch and only being indexed if they specifically ask to be by submitting a form. To me, that is not a good solution I would recommend. Most people either want to be indexed by all search engines, or none at all. By using a system like that it would make it impractical for someone who wishes to be indexed to have the burden of reaching out and contacting every search enginer in existence.
I'd much prefer to stick to standards and where those standards arent implemented, then put the pressure on the people to implement them rather than to put the blame ont he search engines who honor the standards and those standards, when implemented, give you complete power and control over if you are indexed.
Amber (@amber@toot.site)
I'd just like to add that a lot of us use the fediverse instead of conventional social media so that organizations aren't able to index what we say and do. Fedisearch (along with another project that I believe is from the EU (I can't remember it's name)) defeats that and could facilitate surveillance.
Sure, but they obey noindex, noarchive, and robots.txt.
So anyone who does not wish to be indexed they honor. So while I agree many people do not wish to be indexed, and I think they should have that right, its hard for me to see what the problem is here, you wont be.
Or are you suggesting indexing the people like me who actually do want to be indexed is somehow harmful to you?
> is somebody opting in to be indexed is harmful to you
Take hellthreads. I'm stuck in a few of them. If someone posting in them was indexed it could associate me with antisemitism, transphobia, etc.
But since **you** are not indexed then the only way youd be associated with it is if someone went to said hellthread and actually read it (since any search for your name or references to you wont come up).
People can find you in that thread in that way whether you wanted to be found or not already.
@freemo
True true. Adding some insights on behind the scenes, our crawler only visits mastodon, pleroma and misskey instances, because it only knows how to parse content from those instances. Some hubzilla posts get indexed because they appeared on the federated timelines of those three type of instances.
@hansw
However if you truly feel the standard we have now is inadequate then I'd say the solution would be to petition to have the standard amended, and then you would still have the task of ensuring instances adopt the standard.
@fedisearch @fedisearch_com