What would you do if a facial recognition system denied you access to your train? How would you feel if your rental application for a new home was rejected, simply based on an image of your face? These scenarios were simulated for over 230 partners and senior leaders at KPMG over the month of May in immersive ‘Face Value’ sessions co-delivered by the UTS Human Technology Institute (HTI) and KPMG.
How does facial recognition system work?
Face Value is an emotive app-based experience that allows users to discover first-hand what it is like to interact with facial recognition systems and have these technologies make decisions which impact their daily lives. The tool was developed by HTI and design group, PaperGiant to undertake qualitative research to inform the development of HTI’s Model Law for Facial Recognition Technology, published in September 2022.
Participants who failed the tests were moved to 'cattle class', while those who passed enjoyed the comforts of first class.
The scenarios presented in Face Value reflect plausible, real-world facial recognition solutions. The app assesses a range of characteristics of a user’s face, including their age, gender, ethnicity, trustworthiness and potential for aggression, and draws inferences from these data points to make a final decision.
During the KPMG sessions, participants who failed both scenarios were asked to move into the highly surveilled and overly cramped ‘cattle class’ section of the room, while those who passed both scenarios were able to help themselves to refreshments in the comfortable first-class lounge area. Participants with a pass-fail moved across to the premium economy zone.
Following the immersive phase of the session, facilitators led a group discussion to draw-out participants’ immediate emotional responses to the Face Value experience. Discussion then moved towards considering ways to improve strategic policy and decision-making processes underpinning the development and deployment of these technologies, and their regulation and governance across different contexts. As one participant remarked:
I was in shock, it was such an alarming experience, it felt totally unfair to be judged in this way. A pertinent reminder that we need to take careful action in managing the risks in this rapidly evolving space.
Professor Nicholas Davis and Lauren Perry from HTI ran a total of seven sessions, engaging employees responsible for areas covering AI strategy, procurement, deployment and governance. Ultimately, the Face Value experience helps participants develop new insights to inform richer, more human-centred conversations about how we can enjoy the benefits of these technologies while protecting individuals from harms such as discrimination, over-surveillance and inaccurate or unfair decision-making processes. As one of HTI’s anchor partners, KPMG is working to be at the forefront of discussions about the risks and opportunities offered by new technologies.