Coalition
A motion-based interactive experience about diversity in an oppressive society.
Made in collaboration with Ridwan Madon, Xiaowei Lu and Yibing Qian.
Concept
Coalition is an exploration of motion as expression of individuality and the struggle against oppressive societies. It is an immersive live experience that represents the union of motion and sound conveying individuality and uniqueness against the status quo of society.
We see motion as a form of expression, which conveys individuality and emotions. When placed in the context of its environment, this uniqueness and diversity will often be met with resistance, as society as a whole prefers to maintain the status-quo. This oppression has long lasting direct and side effects on communities, and is ever present in our times. But where as individuals, we are powerless against society, as we unite we aim and thrive for the common good.
Capturing movement
To illustrate diversity in a movement-based experience, we selected dances from four different cultures. In this sense, the minorities we showcase represent the oppressed migrant communities around the world, struggling to make a home in a new place.
Using NYU’s OptiTrack motion capture system, we recorded each of the dances in different forms, letting us seamlesly move between states depending on the user input.
Motion Controllers
In order to promote movement from the audience which we could track, we relied on physical controllers. Our research showed that people were more willing to move when they had an implement at ther disposal. Thus, we 3d modeled and printed two different controllers, fashioned after rhythmic gymnastics tools: a baton and a ribbon. The spherical blobs on the top were covered with reflective tape to be tracked by the OptiTrack system.
These controllers house inside the components needed to communicate with the main computer via bluetooth, assigning a color to the controller. RGB LEDs would display this color on the middle section of the handle, matching the color and signaling the avatar each member of the audience controlled
The environment
To accompany the dances from each culture, we crafted a digital environment containing objects and symbols characteristical to them. Each object would have the chance to appear on the environment depending on the avatars spawned by the users. This helped us further make the connections between the dances and the cultures they represent.
This virtual environment is projected on three walls of the installation. Layers of organza are hung to create more depth and enhance the immersion. Unfortunately, this material creates interference with the motion capture system, meaning we had to place them almost touching the walls.
User experience
In order to make the audience part of the projected virtual environment, each user spawns an avatar as soon as they start dancing with the controllers. As long as they keep dancing, their avatars will dance along, and it’s up to them to choose the fate of their virtual dancer. Whether they just stop or choose to dance with someone else, the effect on the avatar -and the environment- will be different.
Installation
This installation aimed to instigate a reflection on this issue by letting users explore a 3d environment via motion triggered by their own expression. We achieved that by making the audience become part of a diverse virtual community, represented by choreographies and sounds from different cultures. Through their own movements and interactions, they transformed this installation into an experience of awe and joy.