Sound starts at 1:18.

Demoing FarbeShan, a program created by Chi-Hsia and aBe in one day during one of the Processing Code Jam events in Berlin. This application allows painting on top of video. The video file can be selected when starting the app. Each path drawn by the user sends OSC messages to SuperCollider including hue, saturation, brightness and alpha values of pixels under the path. Those are then converted into sound.

Event: http://www.meetup.com/opentechschool-berlin/events/114338982/ Source code: https://github.com/hamoid/FarbeShan