For the final project, we continued to develop from our last project Receipt 1.0. This time, we wanted to integrate physical computing and sound into our project. I documented voice from few people at Washington Square and ITP. It was an interesting experience asking random strangers outside to record their stories. I recorded about five stories, and we chose three to use. I found that a comfortable and quiet environment help getting higher quality stories, and I also got better in asking the right questions to get the most storytelling component. 


To integrate physical computing, we thought about using light. It reminds me of a film set I saw, designed by Angran Li, as the picture shown below. The film is called The Visitor. This picture inspired us to create a light effect for each receipt. When viewer read the receipt, light is on. It is like the receipt become alive. When they put the receipt down, light fades off. 



This is my first time composing in a project.


With light and audio, this artwork became a very personal experience for audience. I felt very happy to be able to find those intriguing stories and transform them, to create a space for sharing stories. For the next step, we can improve our interaction design, collect more recordings, and install this in a larger scale. For example, we can explore how to connect Unity with Arduino, so we can turn lights on/off when the image target is triggered. 




I collaborated with Chengchao (CC) Zhu on this AR project. CC first came up with the idea of using receipt as the main subject of this project. Receipt is a small daily object that we do not pay much attention to, but it is the trace of our important life decisions. We wanted to use AR to reveal big life moment through a small daily object. We started with four objects that each relate to a life story. We tried to think about big life changing moments, like dream, work, children, and death. 


We wanted to project the image target onto the receipt paper roll, but it became difficult to scan the image target. We changed to tape paper receipt onto the roll. We struggled a little to make the installation visually interesting. We added a trash bin, and it really added story to the installation. We intended to make it look like a discarded corner of a room, so audience would discover something interesting from a pile of seemingly abandoned trash. What is more interesting is that, few days after we installed it, we found the receipts were thrown away by someone and a trash bag was put on the trash bin. Is this art or trash?  




For this project, I wanted to film something, so I thought about integrating film and theater with Max and Arduino. I am always interested in taking live performance out of its traditional venues and see how that changes people's experience. So, I decided to film something theatrical. Another inspiration for this project is to create magic or a magical sensation. I hope my audience can experience a magical feeling from my artworks. To me, pull a light switch is the beginning of the magic. A pull chain switch seems like an old technology, but what if it can turn on something besides a lamp? 


The picture on the right is my write-up and script I gave to my actor, Molly Siskin. The character is a clown. I used this script as a guideline, and we actually ended up mostly improvisation. After I met with the Molly, she told me that in her clown training, clown did not speak much. While filming, we played with a different prop each take. We also found using music wass very helpful for clown improvisation. 


In the installation, I used Arduino to connect a light sensor to sense lamp being turned on or off. I connected Arduino to Max through a patch called SensorBox, and I used Max to control the video playback. 


Originally, the design was that clown appeared when light is on. After testing with two audience, it seemed the opposite made more sense, clown appeared when light off. When the light is on, it is a normal living room setting. When the light is off, clown appears.



After class critique, I felt very encouraged to explore more in interactive performance. One of the audience picked up the teacup expecting the cup would interact (unfortunately not yet). I can make more interactive props for in the future.



This is a group project I collaborated with Gilad Klein-dor. I was excited to use projection mapping for the first time.


Day 1: I wanted to create a miniature world that mini human dwell in. I first imagined the installation to be a web like structure (picture reference below). Mini human walk on their paths, and those paths weave into a web structure. 

entangled lines

entangled lines


Day 2: We started by creating a video of a person walking in a square. We used Premiere. We keyed a green screen video of a person walking, and we made him walk in a square using keyframes. We tried to project this first video onto the wall. We realized if we sized the human down, his would walk in a smaller square. Our next step would be figure out the distance we want the little human walk.

Day 3: We tried to create more animation by using After Effects. This is my first time using After Effects. We put few tapes on the wall and tried to map it onto the tape. When we mapped the animation with MadMapper, it was very pixelated and easily distorted. Although we tried to adjust the number of pixels in After Effects or move the projector closer, it was still not very ideal.


Day 4: We started to think about the physical installation of the project. How could we take the mini people out of the wall? We first thought about hanging a frame in the air and put tape across. We bought PVC pipes and connect them into a square. It doesn’t look visually very interesting as we expected.

testing PVC frame and projection mapping

testing PVC frame and projection mapping

Day 5: The next day, we decided to put tape in a corner, and it looked amazing. The corner space is very inspiring to me. I started to drop shapes onto the wall through MadMapper, just to experiment. Gilad liked it a lot, and he expanded our animation to not only walking but more movement. Through MadMapper, I drew shapes in the projection and created a world that these mini people live in. Those shapes create a minimal, geometric, yet dynamic world. I also changed two tapes from 1inch to 2inch. It makes the mini people less pixelated, and the 2inch tape also pop more to viewers’ eyes to create more dimension.



To me, this artwork reminds me a conspiracy that human world is a mini lab controlled by aliens. In this installation, the viewers become the “alien.” How does this perspective affect the audience? The mini people in our installation behave like they have a set destiny of what they are doing, but they are unconscious about their destiny. They follow it without doubt. This art also explores the theme of path, finding path, following the path, or not.




Chakra 2050 is an interactive installation inspired by ocean pollution and chakra. The fish tank represents ocean, and the glowing jellyfish represents marine lives. Originally, the design was to ask participants put trash into the fish tank to highlight the message of our increasingly polluted ocean. Later, we reversed the interaction and decided to ask participants help pick the trash out instead. We changed the interaction because we felt that taking the trash out is a more positive interactive strategy. By picking trash out from the tank, people proactively participating in solving the pollution issue. With the trash already sinking in the tank, it visually expressed the uncomfortable living condition that marine creatures dwell in. Then, through participants’ action, they help provide a better environment for jellyfish.


Inspiration & Reference

Inspired from Olafur Eliasson's works, he creates space that make viewers immerse in the light. We wanted to paint the water with light.

Reference pictures:


We used Phillips Hue products to light the installation. The LED strip was to mimic the ocean wave, and the back light showed chakra colors. 



We added sand, fake plants, and weight for the jellyfish.