A synaesthetic realization of the latent mass within negative spaces, the Interstitial Fragment Processor collects and drops the contoured shapes formed within and between the bodies of its participants. Elastic red and blue animated objects plummet toward the gallery floor, producing audiovisual improvisations on vertical descent and collision.
Category Archives: Int Programming
Computer Vision / Interstitial Fragment Processor
Computer Vision / Eyecode 2007
Eyecode (Golan Levin, 2007) is an interactive installation whose display is wholly constructed from its own history of being viewed. By means of a hidden camera, the system records and replays brief video clips of its viewers’ eyes. Each clip is articulated by the duration between two of the viewer’s blinks. The unnerving result is a typographic tapestry of recursive observation.
http://www.flong.com/projects/eyecode/
Sounds of Journey
The idea is simple to translate the journey of a person into a continuous stimulation of moods and emotion. Sounds the resultant of this stimulation is produced by changing speed, direction,relative distance to A & B and the compass “look direction” to produce a multitrack “song” that with time, the user can play with it’s composition.
This is done by using an app called antimap, which captures your position, speed, direction to the compass, while you are rooming in the city. Processing is use to make a sketch which uses these data and translates it into into a visual & sound experiences. So you not only see put also hear his or her journey.
So with a this basic concept we went to drawing board and started sketching how the display would look like and what kind of environment the object would be. The object is just a representation of a persons journey.
So We (Lucas De Sordi & me) found a somehow similar sketch in open processing website (link here). We used this sketch as a reference for our idea because it uses the potions of mouse to produce a certain kind of sound. we liked the idea of a certain kind of sound.
We first made a sketch that visualizes the movement of mouse to produce sound. This was to test the variation and range of sounds that can be produced. Later this movement of mouse would be replaced be the movement of humans in the city.
Untitled from Arfurqan on Vimeo.
In next step (major coding) the data from antimap, the visual display and the production of sound. All these happen written into a simple code. Here are a few screen shots.
Screen Shots
Since the sketch would not upload to the blog with its data (for now). we made a video.
ok from start we wanted to have a more zen like peaceful melodies sounds, Since the example for the sound was not the right example it was hard for u the change it at this moment, secondly the sound was going to be produced by the direction of once head and this event would also be shown on the display.
Your moves into sound
Ever wondered what would happen if you tracked your motion, used your motion parameters in building a sound wave? I also wondered and thought we can try. Click here to listen to the result (ps: it is super noisy).
The initial idea was to track my skateboard rides and map the falls! (because I fall a lot on the side walks) where the repetion of the zero speed parameter, will make a rhythm. However, due to GPS problems with my phone, I ended up using random values that don’t correspond to a specific motion track.
The tone was generated by building a sine wave, which is constructed by 3 parameters, a frequency, an amplitude [-1, 1] and a sampling rate. You can learn more about sine waves here . The sketch on the left is a quick render of different waves constructed with different frequencies and amplitudes, which I generated using Audacity. Even though, we are converting data to sound and not the opposite, it is still important to learn how waves are constructed before we build them.
Now, as far as processing is concerned, it seems that minim library makes it an interesting tool to deal with sound, nevertheless, minim examples, which are installed by default in your package, and which come with an exact illustration of how sinwaves works in your code (click Sinewave on the left tab). You don’t have to stick to sinewaves, you can also construct your waves using square or triangulate functions. They are all controlled by the same 3 parameters: (frq, amplitude, samplerate).
In order to move to the code, after understanding how sound is being built, we need to start by having a look on how classes are built , then we use that to manipulate Antimap’s example (Yeah, we all love free examples), or generate your own from scratch, if you aren’t a fan or freebies. I needed it to help deal with csv data input, however, I think that table() could provide a better solution, but I didn’t try it. The whole idea is to use different arrays to control the sine wave parameters in the function SineWave(frq, latitude, out.sampleRate())
then you can manipulate the different values from different arrays and see how interesting results could come along. You can also control sine.portamento() for different effects. If you got a the “buffer underrun in AudioOutput” it is mostly because your draw function has nothing there, so check the processing forum for tips, also don’t forget the minum.stop () at the end of your code, otherwise the noise will loop forever, and it is too noisy indeed:)
computer vision. ping
PING is a low-tech augmented reality videogame that overlays a moving pixel to a videosignal. The pixel bounces off from objects that are darker than a specific threshold value. More about this projects at http://www.niklasroy.com/project/101/PING