Counterproductive is a short film about the consequences of algorithmic bias in artificial intelligence. Thesis project in collaboration with Ravin Raori at dfpi.
The Bartlett Fifteen Exhibition 2020︎︎︎
IALab official link︎︎︎
There is an increasing dependence on AI in the daily lives of human beings. As people co-inhabit the world with these technologies, they need to understand how their algorithms work and to what extent they are able to affect their lives. The film investigates the algorithm as a human creation, questioning its perceived neutrality. Biases in algorithms take several forms and manifest in different ways. The work focuses on biases in training and classification data, how this data is transferred to specific contexts, and the consequences specifically on gender and gender identity.
The research found an increasing dependency on algorithms which sort and classify people. This classification is assumed to be objective. The resulting film is a metaphorical extrapolation of the consequences of this assumption, when living with AI-powered devices has become normalised. The production involved designing and building the devices which serve as characters in the film, and which ‘act’ in real-time during the film. The film was written and produced with a full crew during challenging times of the Covid-19 lockdown. Further, the documentation and interviews with participants serve as a companion film about contemporary gender relations.
The work of Joy Buolamwini︎︎︎ is especially relevant to our research as it highlights how data in algorithms can exclude people that belong to oppressed communities. Her work stems from her own master’s project where she was investigating why a facial recognition algorithm wouldn’t recognise people of colour. She came to the conclusion that the problem lay in the lack of diversity prevalent in the data used to train the model.
All props for the film were designed and manufactured at the Interactive Architecture Lab, The Bartlett, UCL at Here East.
The film Counterproductive was shot in 4 days over 5 locations during the November 2020 Covid-19 lockdown.
Full Movie upon email request︎︎︎.
The lamp was trained using a machine learning model that could recognise how wide the user opened their hands as a gesture to turn lights on and then built upon that to see what a future smart lamp potentially could do. The idea of masculine surveillance was explored through the lamp.
“What if the lamp’s gaze could follow you everywhere you went?”
Eventually while shooting, the lamp was also connected to a controller that would allow the film crew to manually control it, behind the scenes as the actor interacted with it in front of the camera.
The kettle was trained as a model to recognise when faces were smiling and when they were not based on track points on their lips. This information was then mapped as visual feedback to show the kettle’s willingness to boil water as and when someone would smile at it.
The toaster was a manifestation of what interaction would look like if a user had visual feedback on their voice. Based on interview research, it was concluded that this is something that women face on a daily basis and defines how seriously people take them. The toaster only toasts bread if the user’s voice is under a certain decibel level.
Distinction Project, Design for Performance and Interaction, MArch, DfPI
Best Sci-Fi, Best women short, Best Director, Best Actress, Best production design and runner up for Best Film at the @independentshortsawards
Best Student Film @aimaffestival
Photos all by Redeye Recordings︎︎︎