Follow
"Someone shouldn't review hits for CSAM, they should let the algorithm do it's thing."
Someone said something like that. Except, there are issues like false positives, questions about the curation of the data (yes, there are cases where something is erroneously included), and so forth.
A while ago, there was a bit of a scandal over someone's Google account being terminated over photos taken for medical purposes. They could never get it back. It's not clear it was an algorithm, a human moderator is unlikely to consider that either.
However, if someone takes issue with cases like that, it's strange to call for less review.
Without someone manually reviewing it, it also means automatically accusing someone of being a criminal to the police.
And think about how many services one company might operate, someone might lose access to a lot of things based on an algorithm accusing them of something.