pouët.net

Potion by [drgn]

Live Performance @ Nordlicht 2014 / Bremen, Germany.
Scored 3rd place in the "Wild" Competition.
Setup : Microsoft Kinect 1 on a NVIDIA Jetson TK1.
Software : Moodshades 0.4
Dependencies: LibFreenect, OpenAL, OpenGL, Libusb

----------------------------------------------------------
Youtube Link : https://www.youtube.com/watch?v=fN_zsTROvls
----------------------------------------------------------

Some details : The Kinect delivers depth data @ 30fps, so
there is a latency of at least 33ms - 66ms (frameexact
interaction is nearly impossible). The Kinect also
processes the data in about 100ms. Moodshades uses a
stable detection of trigger movements which needs 3 frames
(66ms). The overall latency is about 220ms and sometimes
varies. This makes it VERY hard to play live along a
scripted beat sequence, even if you perfectly trigger the
right regions at the right pace. The potion effect is
based on a WebGL / Javascript effect from Flexi23, which
i ported to OpenGL / C++ for Linux to work on the Jetson


Some more details : I arrived at the party with literally
nothing done and at least managed to show "something":
The first effect part (snow particles, aligning to the
contures) worked on the last minute test (thx shd) but
refused to run on the presentation. So many ideas (harp
play, different drum sets, effect parameter via xyz
position of a hand, chiptune emulation, major/minor
/septime accord interpolation, multiple shader stage
effects, gesture controlled script instead of autoscript)
could not be finished, just because of no time. In the
end, i am very happy that i left some impression and even
won a little trophy =)