2023 : BEYOND AUTHORITY

Theme

The project centralises on the role of technology in society - how it can simultaneously connect and disconnect us. It is an exploration of the contradiction inherent in our connected digital world - the promise of connectivity and the reality of emotional disconnection and misuse of power.

Domain

The main domain of our project lies at the intersection of Interactive Art and Technology. We use elements of speculative design, digital media, and physical computing (Arduino and sensor technologies) to create an immersive installation that provokes thought and encourages conversation about our digital behaviors. More specifically, we touch on theme related to digital ethics and psychology, particularly in the realm of online behaviors and their emotional implications.

Akbar Putra Novial
As a part of the developer team, I played a role in implementing our project by channeling my focus on programming aspects, serving as a resource for both Unity and Arduino implementation. I assisted in implementing the sensors for the interactions, with the lever interaction being my main responsibility that I implemented for the final prototype, along with soldering the necessary wires for the other sensors and interactions. Collaboratively, with my colleagues, I participated in research and developing the design concept, while also crafting storyboards based on their scenarios. I also served as a versatile model for the installation, including acting out the various output reactions based on user inputs, adding an element of realism to our installation.
Aleks Siroki
Contributions & Role. As the team leader I focused on academic research related to power and authority, which helped to inform the design of our interactive installation. I assisted in crafting user personas and scenarios to better understand and cater to our user base. I was involved in cognitive walkthroughs of our micro-prototype and the mannequin, ensuring an optimised user experience.
Sergey Gerasimov
As designer, I contributed to concept creation and prototype iteration through the entire semester as we saw our project and message evolve from the “protest” theme to “technology disconnection”. I was engaging in brainstorming activities, relevant research and documentation. As lead developer, I heavily contributed to technical implementation of both the first prototype (30cm mannequin with Arduino Lillypad) and of the second prototype (2 meter mannequin with Arduino Uno and external sensors). I was responsible for developing Unity and Arduino input interactions and the corresponding outputs for Light, Sound, Temperature, Accelerometer and Lever. For the final prototype, I set up Arduino Uno and developed the wiring architecture for the external light, sound, temperature and motion sensors and connected the hardware set up to our Unity scene, ensuring that the interactions run smoothly.
Shivam Shipankar
I utilised the design thinking process to generate ideas and concepts for our group project. By conducting extensive research on the topic, I gained a comprehensive understanding of the design concept. I sought out the perspectives of various stakeholders through interviews, allowing us to gain valuable insights for the development of our project. After analysing the received feedback, I collaborated with the team to implement the necessary design modifications, helped in implementing the lever interaction. In addition, I played a crucial role in setting up the installation, ensuring a smooth and aesthetically pleasing experience. Finally, I created prototype videos that effectively demonstrate our design solutions.

Methods Used

Speculative design to provoke thought. Embodied interactions to trigger digital responses. User scenarios and storyboards to map out interactions with the installation. User testing to collect feedback. Cognitive walkthrough to identify confusing parts. Role play to identify position of the lever. Interviews, observations, academic research to solidify intended experience with outcome.

Keywords

Empathy, Power, Authority, Technology, Cyberbullying, Embodied Interaction, Speculative Design, Power Dynamics

Technology Used

Arduino boards and sensors to detect user interactions with the mannequin, including motion, light, sound. Unity for the development of the visual elements, such as pre-recorded videos and threshold levels. Physical objects such as police baton, flashlight, and headphones for participants to engage with the mannequin. Lever mechanism to simulate empathy.

Concept. Our interactive installation, "Beyond Authority – Unmasking the Digital Veil", is a symbolic prison that showcases the dark side of technology, such as facilitating bullying and eroding empathy. Participants play as prison guards, demonstrating the power and responsibility people have in shaping a more connected society.

Narrative. Participants navigate a prison-like environment where they have the power to harm a mannequin. The mannequin isn't literally representing technology itself, but rather the emotionless, dehumanised, and often anonymous nature of our interactions within the digital space that is largely shaped by technology. It serves as a physical embodiment of the faceless individuals we interact with online and the impersonal feeling that technology can sometimes create. Through this interaction you'll learn how human behaviors, attitudes, and choices in the digital space can have tangible impacts. We show how easily we can cause harm or discomfort when the recipient is reduced to just a figure on a screen.

Intended Experience. It's all about choice. Participants are faced with a decision - to continue inflicting harm using the objects provided or to pull the lever, symbolising a break from the negative use of technology. This choice reflects individual attitudes towards online interactions.

Outcome of Interaction. Participants experience first-hand the potential consequences of their digital actions. This immersive experience is designed to evoke reflection on one's own digital behavior, making participants conscious of their online actions and potential to cause harm or foster connection.

Message. The installation aims to unmask the disconnection prevalent in our digital society. We invite participant to step into the shoes of a digital oppressor and see how it feels to hurt someone. In contrast to the objects of opression we offer a metal lever that serves as a beacon of hope in this technological dark prison that is ubiquitous in our lives. The ultimate goal is to inspire a more mindful and empathetic use of technology, transforming the digital prison into a truly connected realm.

Join us on this exploration of the hidden side of technology, as we uncover the disconnect that lies beneath the surface of our digitally connected existence.

Beyond Authority – Unmasking the Digital Veil Poster

The mannequin resembles emotionless, dehumanised, and anonymous interactions in the digital realm

The Lever - symbol of freedom & empathy. Used to transform the digital prison into a connected realm

The police baton represents power and authority. It is used to harm, upset and provoke individuals for amusement

Flashlight represents doxing. It is used to publish private information without consent as a form of punishment or revenge

Headphones represent the flood of harmful messages or unsolicited content. It is a tool to shame, humiliate, and belittle individuals in the digital world

Technical Description

The Installation. The installation in the form of a 3m x 3m Marquee covered with black cloth and wrapped in the chicken wire depicts prison like environment - dark, unsettling atmosphere with a distant sound of screams, heavy breathing, cry. A table with 3 objects to harm a mannequin, standalone wooden post with metal lever to facilitate empathy, prison bar in the form of a gate, a mannequin and TV are placed inside the Marquee.

The installation takes form of a Marquee 3m x 3m

Introduction to the Concept. Before engaging, a pre-recorded narration in the form of a 1-minute audio file will be played through the speaker. The deep tone male voice explains the concept, participant's role, rules of engagement and deeper meaning necessary to trigger reflectiveness.

Engagement with the Mannequin. The mannequin contains Arduino Uno board located inside the funny pack. When participants interact with the mannequin, sensors on the Arduino Uno trigger corresponding pre-recorded videos. In total, there are 10 video clips with 10 audio voice overs depicting different scenarios when we interact with the mannequin

Baton - 4 videos / 4 voiceovers
Flashlight - 1 video / 1 voice over
Headphones - 1 video / 1 voice over
"Pain" warning at counter hit #5 - 1 video / 1 voice over
"Pain" warning at counter hit #9 - 1 video / 1 voice over
The "end game" final hit #12 - 1 video / 1 voice over
Pulling the lever to release prisoner - 1 video / 1 voice over

All sensors are located inside the mannequin to reduce risks of damaging the circuit board

Blood splashes indicate physical damage. Overall, each video played depicts different interaction scenarios

Headphones cover the light sensor hidden inside the ear of the mannequin. When change is detected by Arduino a video is displayed in Unity

Health Bar in Unity records hits and indicates the intensity of interactions for participants

- Each interaction corresponds to one of 10 pre-recorded videos. An encouraging voiceover rewards participants with 10 different phrases like "Good job," and "Excellent," each time they harm the mannequin, reinforcing the harmful behaviour.
- Participants may use any object multiple times.
- An on-screen "Health Bar" indicates the intensity of interactions. After 12 hits, it changes color, signalling the end game with a video of a human in severe pain.
- At hit counts 5 and 9, "Pain" warnings display a person begging for mercy, promoting reflection and consideration of the empathy option.
- Choice 1: If participants hit the mannequin 12 times, a video of a person in agony plays. A sarcastic commentary underscores the ease of inflicting pain and the impact of our online actions.
- Choice 2: Pulling the lever triggers a video of a person being freed. A calming voiceover reinforces the importance of empathy and human connection in our digital world.

Technology that Promotes Disconnection, Bullying and Oppression All interactions are coded using Arduino Uno board. Laptop with open Unity scene is connected to TV. When sensors detect change, the corresponding video is played automatically on the TV. To inflict virtual harm 3 objects are located on the table:

Police baton is used to change the accelerometer data on the mannequin necessary to trigger specific output in the form of a video

Flashlight allows the light sensor on Arduino board located in the eye of a mannequin to detect change in the surrounding light and output a video in Unity

Headphones placed on the mannequin cause noise discomfort imitating flood of harmful content

Police Baton - accelerometer detects the movement of the mannequin and located on the right side of the shoulder. When the necessary threshold is achieved, the video will be shown on TV.
Flashlight - used to allow light sensor on Arduino board, located in the eye of a mannequin, to detect changes in the surrounding light and output a specific video.
Headphones - used to cover the light sensor installed in the ear of the mannequin. The change in light (headphones cover the ear) result in the output of the corresponding video

Technology that Facilitates Empathy and Emotional Connectivity

The metal lever on the wooden post is connected to the Arduino board using tinfoil wrapped around the handle and a cable. When participants touch the handle they put pressure on the tinfoil.
Once the Arduino detects the change in pressure, it communicates with the Unity scene on the connected laptop to trigger a video. This video on the TV show the prisoner being released and the celestial voice over explains the potential for a more empathetic and connected digital world.
Warning signs such as "Danger", "Hazards", and "Don't Touch" are deliberately placed to deter interaction with the lever as the main emphasis is based around paradoxical nature of our digital behaviours.

The metal lever on the wooden post is connected to the Arduino board using tinfoil

Warning signs such as Danger, Hazards on the metal lever deter interaction with it