Final Documentation

Final Documentation

For my final project, I did research on many different fields. At the beginning I was planning to do a game based Kinect project. Then, since this final project is a site specific project, I changed my idea and decided to do a music based Kinect project for music events. Finally, as I recall the reading of VIS 145A, I remembered there was a cybernetic reading about video, architecture and television by Graham which inspired me for my project to do something with repeating and delay. I did research on games like snake and tetris for my midterm project, so for my final I would like to combine time delay and these early games. I named my project Shadow.

Video can always capture people’s action and immediately provide a real time video feedback. However, if a perceiver views his behavior with a delay, it will affect how he react. My project has four shadows following the perceiver. There is a one second delay between the movement of the perceiver and the first shadow. There is a three seconds delay between the first shadow and second shadow and same as third and fourth shadow. When the perceiver starts to move, they can interact with their shadows. For example, they can say hi to their four shadow. It looks like you have three twin brothers or sisters but they are following exactly what you do. As I test the delay, I tend to focus on the screen of my real time video feedback. However, if I look for real time video feedback I will forget what my real movement is. Other shadows will also affect how I interact. This is inspired by the Smith’s (scientific) experiment, which introduced time delay between acting and seeing.Screen Shot 2016-05-31 at 12.16.13 AM.png The reason I used shadows following each other was because the idea of the snake game. Since my midterm project was an animation similar to snake game. I wanted to create a “real person” snake game. In the future maybe I will create a slider that controls the number of shadow so that people can change the amount of shadows and interact with them.

Here is the screen recorded video.

Not only the player can control the project. There can be a second person controlling the screen and the Kinect. For instance, the second people can press v or h to flip the image vertically or horizontally. It will also affect player’s action. When you move to the right, the image will show you moving to the left. When you move to up the image will show you moving down.

The background music is from a cybernetic video project named Grooverider. I think it fits the feeling of my project because it is a looping sound. Or this project can be just silent so that people can focus more on their movements.

For the installation scenario, I think it can be displayed in art gallery or public spaces.(Such as check points, airport and we can even study for the movement. Professor Wade) Also I would like to display it in between two mirrors facing each others. In this way I can see my self infinitely.

When I do my project I also thought about distortion mirrors, depending on how you move your body, you will be able to create different effects. For Kinect, people can move their body forward and backward to create different effect.  You can even become a thousand hands “Guanyin”(a Buddha goddess).

300533980386133700342636008_950.jpg

Since this is a cybernetic art project, from the perspective of cybernetic, every movement you made in this project will create an outcome. Meanwhile, the outcome you created will affect how you make you next movement and this goes on constantly.

REFERENCES

Graham. Video, architecture,television excerpt. VIS145A Reading.

Smith’s (scientific) experiment. Diagram and caption quoted from: Eye and Brain, by R.L. Gregory, McGraw-Hill, New York, 1966.

Grooverider – Cybernetic Jazz [Music Video]: www.youtube.com/watch?v=jheagv4VXZM

 

Documentation 1 and 2

Final Prototype and ofxAddon Research

For my final project, I will play around with present and delay by using the Kinect. I will be using few ofxAddons such as ofxKinect, ofxOpenCv, and probably ofxBox2D and buffer and shader.

ofxKinect

ofxKinect is an addon that allows people to connect Kinect and Openframework. Kinect can not only captures the video images but also the depth of the images so it can create more possibilities for my project. Since I am going to play around with video delay, ofxKinect is a good chose to start my project. Originally I was going to use the webcam, however, Kinect allows me to play around with depth, so I think using Kinect is better than the webcam.

This is a ofxKinect addon example that I played with. It can successfully calculate the depth of the image. White part is more close to the Kinect and the dark part is away from the Kinect.

Screen Shot 2016-05-30 at 7.54.31 PM.png

ofxOpenCv

ofOpenCv can find the target and recognize it. I played around with this openCv example and this can be apply to my project.

Screen Shot 2016-05-30 at 8.05.56 PM.png

ofxBox2D

ofxBox2D can provide a way that allows us to add different polygons, or joints and many other interactive thing to do. It can be combined with ofxKinect or ofxOpenCv in order to control polygons or other elements using our body. However, I am not sure if I will use this addon in my project or not.

This is an example that I played with to see how ofxBox2D work.

Screen Shot 2016-05-30 at 8.13.31 PM.png

Prototype of my project

Screen Shot 2016-05-30 at 8.22.57 PM.png

I connect my Kinect and openframework using the addon ofxKinect. At this moment I need to get familiar with the depth of the Kinect. I played around with how to tilt the angle of the Kinect and how to change the color of the signal light.

I tried few addons and finally ended up with mainly ofxKinect and openCv. I incorporated an buffer example so in this way the image can be stored and I will be able to create the delay effect.

I was planning to use ofxBox2d for my project because it looks really fun. However, it might be too much with the delay images and Box2d working together since it is already little bit confuse to play with the delay image. I would rather focus on the delay image first. The problem I faced was the last shadow was always not as complete and clear as the other shadows and another problem was that I have to decide how may shadows I want and the delay time between them in order to create a better effect.

As I working on my project I realized that their was a big difference between for example two shadows and seven shadows. For two shadows I can increase the delay time to around six seconds so I can have enough time to interact with my shadow and also think about my next movement.

This prototype was with just me and the shadow. It is fun to say hi to my twin sister.

Screen Shot 2016-06-06 at 5.22.14 PM.pngScreen Shot 2016-06-06 at 5.20.43 PM.png

For shadows that more than five I have to decrease the delay time otherwise it is too long to do next movement.

This prototype was with six shadows. It is hard to create a good effect with six shadows. I tend to wait the last shadow to finish and then start my new movement because I was confused and was not able to find myself in the video.

Screen Shot 2016-06-06 at 6.00.16 PM.png

Screen Shot 2016-06-06 at 6.00.26 PM.png

Screen Shot 2016-06-06 at 6.01.48 PM.png

After I add flip horizontal and vertical and also music, I came up with the idea to test this in dark so I hide in my closet and use my phone as the light source.

Screen Shot 2016-06-06 at 6.28.50 PM.png

Screen Shot 2016-06-06 at 6.30.37 PM.png

And also with the flash light

Screen Shot 2016-06-06 at 6.31.24 PM.png

In my opinion, the result with the flash light is not very good but I think the one with my phone screen worked pretty good. I had to be in specific distance from the Kinect other wise the closer image will cover the one on the back. I even think about the installation part. It can be installed for music festival or combine with other lighting project.

 

 

Production Concept

Production Concept

Abstract:

For my final project, I am planning to use Kinect as an important addon of my cybernetic visualization. I remembered when I took VIS145A, there was a cybernetic reading about video, architecture and television by Graham which inspired me for my final project. I am really interested in the idea of present and delay. Video always captures people’s action and immediately provide the video feedback. However, if a perceiver views his behavior with delay, it will affect how he react. I will play around with this theme by using the Kinect. Since I am also interested in games, I am going to add some idea of my midterm project and expand on it based on people’s movement. Since this project is site specific, it can be displayed in an art gallery or game based event.

 

Software:

I am going to use OpenFrameWork and Kinect. Also some addons such as ofxKinect and ofxShader. People who wants to interact with the project needs to stand in front of the Kinect and use their body to move around. There will be an internal logic that controls the delay time depending on how far people are away from the Kinect. As the audience, people can use their body to control the visualization. There will be a delay, and all the visualized part will be unpredicted because it will based on how people move their body.872f1a29fd2e7746.png

 

Experience:

This project as a site specific artwork can be display in an art gallery or game event. Since we always see ourselves through videos immediately, this project will create a delay that affect how people interact with themselves and also affect the way they move. It can be a way to express themselves. 

 

REFERENCES

Turns you into a bird: https://www.youtube.com/watch?v=I5__9hq-yas

CAN Kinect Physics Tutorial: https://vimeo.com/49516871

Algorithm Animation: https: //www.youtube.com/watch?v=y629rn6DDv8

Week 2 Cybernetic Artwork

Liwei Wang

VIS145B (Section B00)

Nathan Wade

4/11/2016

Cybernetic Artwork

The artworks that I wanted to discuss about are a series of cybernetic art videos from a Youtuber named Gaierova. In Gaierova’s channel, there are different kinds of math animations that he created based on the concept of cybernetic art.

In his CYBERNETIC KALEIDOSCOPE Series, Gaierova was inspired by the black holes in the universe which cause him to creates colorful set of math art animations. He use circles to warping the surrounding space. The circles are not just independent objects, they are connected with each other and the space around them. This work created the sense of self responding or making response to itself. All the circles are interacting with each other in order to create phantasmagorical colourful landscapes.Screen Shot 2016-04-11 at 6.13.05 PM.pngScreen Shot 2016-04-11 at 6.13.17 PM.png

Screen Shot 2016-04-11 at 6.13.49 PM.pngScreen Shot 2016-04-11 at 6.13.26 PM.png

Another cybernetic art he made is called CYBERNETIC OCEAN. Which was inspired by  art nouveau period, especially the paintings from Gustav Klimt. Waves as the base pattern to form strange and exciting patterns from one moment to another.

Screen Shot 2016-04-11 at 6.14.12 PM.pngScreen Shot 2016-04-11 at 6.14.22 PM.png

Screen Shot 2016-04-11 at 6.14.32 PM.pngScreen Shot 2016-04-11 at 6.14.39 PM.pngScreen Shot 2016-04-11 at 6.14.47 PM.pngScreen Shot 2016-04-11 at 6.15.00 PM.png

The one I like the most is based on fractal geometry named FROM ORDER TO CHAOS.

Screen Shot 2016-04-11 at 6.16.52 PM.pngScreen Shot 2016-04-11 at 6.17.21 PM.pngScreen Shot 2016-04-11 at 6.17.40 PM.pngScreen Shot 2016-04-11 at 6.17.50 PM.pngScreen Shot 2016-04-11 at 6.18.08 PM.pngScreen Shot 2016-04-11 at 6.18.27 PM.png

There is also one based on drum sound named HELIX DANCE

Screen Shot 2016-04-11 at 6.18.42 PM.pngScreen Shot 2016-04-11 at 6.18.52 PM.png

Gaierova’s intent is to make math visualized and changeable. Math suppose to be related to calculation but less related to visualization. By creating cybernetic math art, the viewers are able to visually explore all the amazing patterns that math can create and meanwhile follow its changes.

The logic he used is mostly repeating certain pattern. By repeating a certain pattern, views can see circles interact with each other or intersect with each other to create new phantasmagorical pattern.

What makes this work cybernetic is that this artwork is responding to itself. Every changes the pattern make became part of the next change. What is more interesting is that the music Gaierova use tightly connect to the visualization part and the viewers are able to pay attention to the phantasmagorical colorful landscapes for a long time .

REFERENCES

CYBERNETIC KALEIDOSCOPE: https://www.youtube.com/watch?v=An_8xt1vc_s
CYBERNETIC OCEAN: https://www.youtube.com/watch?v=yjIr_0vf9-I
FROM ORDER TO CHAOS: https://www.youtube.com/watch?v=j3665aPsnbM
HELIX DANCE: https://www.youtube.com/watch?v=ynEKHdvD8R0
More Artwork:
MathLapse – Moiré Patterns: https://www.youtube.com/watch?v=sbMmmjzy7Do
Cybernetic Worm: https://www.youtube.com/watch?v=TZysXHh5ZgY

Week 1 Cybernetic

Liwei Wang

VIS145B (Section B00)

Nathan Wade

4/4/2016

Cybernetics

In my understanding, cybernetics represents the interaction system between animal and machine. When one system is being changed, it will affect the other system and finally change the whole system itself (Wiener). The original idea of cybernetics was created mainly by Norbert Wiener. Cybernetic can be used in many academic and scientific fields such as biological system, computer system, automatic control system and so on.

In 1960s, Soviet Union scientists used cybernetics with computer technology to optimize national economic activities. Around 1964, the American Society for Cybernetics (ASC) was founded and in 1970s, cybernetics was increasingly emphasizing biology and the social sciences. In 1980s, Soviet Union and American scientist collaborated together, doing research and develop the idea of cybernetics. The idea of first order and second order cybernetics were mentioned during this time (Umpleby). As time move towards the twentieth century, some artist started to use cybernetic as an inspiration of their artwork. Cybernetic art become a new form of art. People like John Cage, Roy Ascott, Brian Eno, and Dan Graham all had artworks that related to cybernetic art.

Roy Ascott mentions in his article Behaviourist Art and the Cybernetic Vision that “interactive art must free itself from the modernist ideal of the ‘perfect object’ Like John Cage, he proposes that the artwork be responsive to the viewer, rather than fixed and static”(Ascott). Cybernetic art became a new form of art after modern art which focuses more on the interaction with spectators and also emphasizes the communication between art itself and spectators.

Cybernetic art focused interaction between the art piece itself and the people who participated in it. The audience is also a part of cybernetic art because as an audience, you are actually controlling part of the art piece. The formation of the whole art piece contains audiences’ efforts. For instance, the mirror image and the video image piece requires people to participates in. “The world seen on video, by contrast, is in temporal flux and connected subjectively because it can be identified with to experience duration”(Graham). Compare to 2 dimensional drawings, interactive art allows audiences to not only experience this art piece but also become part of this piece.

The four most important attributes of a cybernetic system are interaction feedback, informations, logic,changes over time and reaction and computation. Peter  Corning mentioned that “The single most important property of a cybernetic system is that it is controlled by the relationship between endogenous goals and the external environment” (Corning).

Cybernetics can be apply to many fields such as art, biology and social system, but what in common was that “Cybernetics is about purposiveness, goals, information flows, decision-making control processes and feedback (properly defined) at all levels of living systems” (Corning).

REFERENCES

Ascott, Roy. Behaviourist Art and the Cybernetic Vision. PDF

Corning, Peter. Synergy, Cybernetics, and the Evolution of Politics (1996).

Graham, Dan. Video architecture television excerpt. PDF

Umpleby, Stuart A. (2005)  A HISTORY OF THE CYBERNETICS MOVEMENT

IN THE UNITED STATES. Washington, DC, Journal of the Washington Academy of Sciences, Vol. 91, No. 2, Summer 2005.

Wiener, Norbert. Cybernetics. MIT Press,1948.

Notes

First wave cybernetics focus on feedback based on a target. Second wave cybernetics started to incorporate language and it is the basic of artificial intelligence. Reflectivity, when one action reflects on the action of another system (rule based system). Using the model to modulate behavior towards a specific goal. Third wave include chaos.
Reaction is not response. Response includes modulation, internal logic.

Autonomy, symmetrical, circulative control.