@icedquinn

Your use of the word "cognition" implies your concern is "AI turning conscious".. an AI doesnt need to be conscious or have "cognition" to be a threat.

@miklo

@freemo @icedquinn "stupid" AI is still danger tool because almost always is powered/trained by big data, that is available only for big players. People, small business doesn't have access to data so cannot build competitive AI tools. So even "stupid" AI is big factor of increased market and social inequalities.

@freemo @icedquinn because of that all we should support every sort of opensource AI project where either code and data are fully available.

@icedquinn

I wouldnt say thats entierly true, though we havent reached the point where it is like the movies yet.

Often we can set rather simple goals for AI and it may have consequences as a result of its optimization that are unique to AI and not in line with our intended goals.

One example would be that AI might identify that most minorities have a poor credit rating. Therefore it may assume minorities are untrustworthy recipients of loans when they do not have any credit history and explicit deny them loans based on their race. While that may be in line with the goal of "maximize selecting people who are likely to pay back loans" it has unintended effects that is not in line with our goals which implies some sense of racial neutrality.

@miklo