'Racist' AI art warns against bad training data
- Published
An artificial-intelligence art project has been criticised for using racist and sexist tags to classify its users.
When they share a selfie with ImageNet Roulette, external, the web app matches it to the ones it most closely resembles from an enormous library of profile photos.
It then reveals the most popular tag, assigned to the matching pictures by human workers using data set WordNet, external.
These include racial slurs, "first offender", "rape suspect", "spree killer", "newsreader", and "Batman".
Those responsible for assigning the tags to the library pictures were recruited via a service offered by Amazon, called Mechanical Turk, which pays workers around the world pennies to perform small, monotonous tasks.
"AI classifications of people are rarely made visible to the people being classified," ImageNet Roulette's creators, artist Trevor Paglen and Kate Crawford, co-founder of New York University's AI Institute, said.
"ImageNet Roulette provides a glimpse into that process - and to show the ways things can go wrong."
Ms Crawford added they hoped the project "gives us at least a moment to start to look back at these systems, and understand, in a more forensic way, how they see and categorise us".
Users have been uploading pictures of their pets.
Allow X content?
This article contains content provided by X. We ask for your permission before anything is loaded, as they may be using cookies and other technologies. You may want to read X’s cookie policy, external and privacy policy, external before accepting. To view this content choose ‘accept and continue’.
Allow X content?
This article contains content provided by X. We ask for your permission before anything is loaded, as they may be using cookies and other technologies. You may want to read X’s cookie policy, external and privacy policy, external before accepting. To view this content choose ‘accept and continue’.
Others have been categorised into professions.
Allow X content?
This article contains content provided by X. We ask for your permission before anything is loaded, as they may be using cookies and other technologies. You may want to read X’s cookie policy, external and privacy policy, external before accepting. To view this content choose ‘accept and continue’.
Allow X content?
This article contains content provided by X. We ask for your permission before anything is loaded, as they may be using cookies and other technologies. You may want to read X’s cookie policy, external and privacy policy, external before accepting. To view this content choose ‘accept and continue’.
Allow X content?
This article contains content provided by X. We ask for your permission before anything is loaded, as they may be using cookies and other technologies. You may want to read X’s cookie policy, external and privacy policy, external before accepting. To view this content choose ‘accept and continue’.
And one person was tagged "heroine".
Allow X content?
This article contains content provided by X. We ask for your permission before anything is loaded, as they may be using cookies and other technologies. You may want to read X’s cookie policy, external and privacy policy, external before accepting. To view this content choose ‘accept and continue’.
- Published16 September 2019
- Published3 September 2019
- Published27 August 2019
