Saving Face
Inioluwa Deborah Raji, Timnit Gebru, Margaret Mitchell et al. · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · 2020
Although essential to revealing biased performance, well intentioned attempts at algorithmic auditing can have effects that may harm the very populations these measures are meant to protect. This concern is even more salient while auditing biometric systems such as facial recognition, where the data is sensitive and the technology is often used in ethically questionable manners. We demonstrate a set of fiveethical concerns in the particular case of auditing commercial facial processing technology, highlighting additional design considerations and ethical tensions the auditor needs to be aware of so as not exacerbate or complement the harms propagated by the audited system. We go further to provide tangible illustrations of these concerns, and conclude by reflecting on what these concerns mean for the role of the algorithmic audit and the fundamental product limitations they reveal.
Cited by 296 works. doi:10.1145/3375627.3375820 Open-access PDF
Authors
References
- Demarginalizing the Intersection of Race and Sex: A Black Feminist Critique of Antidiscrimination Doctrine, Feminist Theory, and Antiracist Politics
- Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification
- Review of “Race After Technology: Abolitionist Tools for the New Jim Code”
- Deep Expectation of Real and Apparent Age from a Single Image Without Facial Landmarks
- Actionable Auditing
- Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness
- Fitzpatrick skin typing: Applications in dermatology
- Where fairness fails: data, algorithms, and the limits of antidiscrimination discourse
- The Misgendering Machines
- Gender Recognition or Gender Reductionism?