pouët.net

our demoish interactive kinect installation

category: offtopic [glöplog]
hey guys,

just wanted to show our 'demoish interactive kinect installation':

https://vimeo.com/51247057

we also have plans to bring it to some demoparties.
added on the 2012-10-12 08:34:14 by pandur pandur
That is so cool! More about the setup and the tech? I'd love to do something similar.
Beautiful. Tell us more!
added on the 2012-10-12 10:13:02 by ham ham
Awesome! Bring it to Evoke!
added on the 2012-10-12 10:21:17 by xxx xxx
Cool :)
added on the 2012-10-12 10:21:32 by gloom gloom
there are 4 xbox kinect cameras positioned at the corners of a rectangle in front of the bigscreen.
the biggest problem was to combine the data of all kinects. it's now pretty stable, in that setup 2 cameras are attached to the ceiling, 2 are hidden next to the bigscreen. so the view angles are very different.
to adjust procedure requires a special "adjustment dance" so the software can match the different point clouds and combine them.
you can now place a virtual camera behind the "players", in this setup it is just used as a mirror basically.

the combined data is broadcasted over network, so different sound/graphic engines can read the data and display graphics/create sounds etc.
we also realized a project that streams data over the internet, so dancers in germany and china can dance together/communicate visvually.

we also have some more effect, which use the skeleton features (at platine only point cloud data). you can see some development screenshots here: http://tom.undev.de/

we plan to show this at some demoparty, not sure when/where...
added on the 2012-10-12 10:25:19 by pandur pandur
What backend did you use? The Microsoft one?
we use the microsoft sdk, but that can only get data from one kinect.
everything else is our custom code.
added on the 2012-10-12 10:37:34 by pandur pandur
looking good
added on the 2012-10-12 11:43:27 by psenough psenough
The remote streaming sounds awesome... especially if was >2 sites with rendering done in different colours for each site...
added on the 2012-10-12 12:42:54 by bloodnok bloodnok
nice, sent it out to my students :)
added on the 2012-10-12 12:44:05 by nic0 nic0
So wait what, you had 4 PC's running for this??
Very cool!

So it requires an adjustment dance does it? Is it anything like this? : https://www.youtube.com/watch?v=6pOq4hyoX9g ... If so I guess it's about time to remake that old classic with a few subtle changes to the lyrics :).
added on the 2012-10-12 13:23:57 by elfan elfan
is it just me who's actually somewhat unimpressed? i mean from purely from a visual perspective it just looks like "fill shape with random polygons and dots and lines"
added on the 2012-10-12 14:44:15 by Gargaj Gargaj
it's the sync with sound that makes it interesting
added on the 2012-10-12 15:41:41 by psenough psenough
<3 <3 <3
added on the 2012-10-12 15:43:51 by nekomono nekomono
Superb!

I hope you will be able to bring it at Revision.
added on the 2012-10-12 16:04:04 by wullon wullon
Gargaj: the "shape" that's being filled is a 3d captured model of a body, which can be also be seen by the not-so-randomly-placed polygons. At least that's how I perceive it. It wouldn't look half as good if you'd only have a 2d filled silhouette of your body. So the real challenge here was indeed the capturing.

Visualwise I tend to agree, that it is not impressive at all, but the overall product is.
added on the 2012-10-12 16:13:51 by xTr1m xTr1m
xtr1m: generating a model in 3d (..ok, 2.5d) from kinect data is pretty straightforward.
added on the 2012-10-12 16:37:06 by smash smash
finall kinect is put to some good use.
added on the 2012-10-12 20:00:38 by CONS CONS
From a technical point of view I'm with Gargaj and smash.
Art-wise this is interesting.

But I guess one has to "experience" that thing in action in order to properly judge it - which is a bit difficult by watching a youtube video. :)

Smooth real-time surface reconstruction from the noised sensor data is a bit harder.
added on the 2012-10-12 22:05:21 by las las
Quote:
xtr1m: generating a model in 3d (..ok, 2.5d) from kinect data is pretty straightforward.

...and consolidating the data of four kinects into a single playpen might also be trivial in that regard, but did you see those two fragments of a kid wildly prancing in front of the screen in pure glee? Magic. Fuck your Vulcan logic.

I'm just filled with questions regarding the screen and the angle of the kinects and projectors.
added on the 2012-10-13 03:13:37 by Shifter Shifter
Shifter: yea, the exact same reaction I've seen at a bunch of interactive installations... Wooooo, im on tv messing with the pretty picture.
The problem with that scene is its still so shallow. I want to see it move past little toys that look pretty towards something that goes deeper, makes you think and is worthy of the "art" tag they are stamping on everything.
added on the 2012-10-14 10:16:38 by smash smash
smash is jealous. he ruined cncd name with spacecut and people started hating him for that. or it was ercola. real talk.

login