If an instance like hubzilla doesnt allow individuals to opt-out then the sys admin still has the ability to opt-in or opt-out the entire server. The users know about that. I agree it is unfair to the users they dont have the power to control that, but the fault lies with the hubzilla developers, not with fedisearch.
I assume by verified opt-in you mean someone going to fedisearch and only being indexed if they specifically ask to be by submitting a form. To me, that is not a good solution I would recommend. Most people either want to be indexed by all search engines, or none at all. By using a system like that it would make it impractical for someone who wishes to be indexed to have the burden of reaching out and contacting every search enginer in existence.
I'd much prefer to stick to standards and where those standards arent implemented, then put the pressure on the people to implement them rather than to put the blame ont he search engines who honor the standards and those standards, when implemented, give you complete power and control over if you are indexed.
However if you truly feel the standard we have now is inadequate then I'd say the solution would be to petition to have the standard amended, and then you would still have the task of ensuring instances adopt the standard.
Sure, but they obey noindex, noarchive, and robots.txt.
So anyone who does not wish to be indexed they honor. So while I agree many people do not wish to be indexed, and I think they should have that right, its hard for me to see what the problem is here, you wont be.
Or are you suggesting indexing the people like me who actually do want to be indexed is somehow harmful to you?
But since **you** are not indexed then the only way youd be associated with it is if someone went to said hellthread and actually read it (since any search for your name or references to you wont come up).
People can find you in that thread in that way whether you wanted to be found or not already.