Here's a half-formed thought I need to mull a bit more on:
Somehow, algorithmic (and especially "AI-driven") decision making tends to only be proposed in contexts where it can only — or mostly — affect those with the least power in the system.
Migrants and asylum seekers.
Prisoners.
Families using any form of state support (child benefits, foodstamps, etc).
Palestinians in Gaza.
It somehow never gets proposed for use-cases where it might affect the wealthy and powerful.
One wonders why. 🤔
There are a few cases that I can think of of such decisions affecting more powerful people, but in a way that's less important for them (e.g. credit scores).
An interesting case is the US college admissions system and the history of its reliance on SAT/ACT scores. IIUC its reliance on SAT (or any kind of standardized testing) decreased over time in the last decade+, but I can't find any good overview sources on this.
