Hi,
has anybody worked yet with MS Kinect? There's this page with various packages to use the device in different environments

http://openkinect.org/wiki/Getting_Started

On paper it should be a breeze to use with Pd (I'm thinking of Mac) but I'm yet hesitating to spend the money.

Jurgen

I haven't tried this yet either. But my thinking for tracking the data goes:

Kinect > Tuio Kinect > OSCulator > Pd

In theory anyway.

I hope to get a Kinect soon.

I now have one, will be bringing it to the Pd Berlin meeting tomorrow night... feel free to come by if you are around. Will post results.

anyone have any good ideas though?

I can see how Kinect is important in the visual world, for 3D graphics e.t.c. but can't think of any uses for sound applications, other than what could already be done with 2 2D webcams.

@arif said:

anyone have any good ideas though?

I can see how Kinect is important in the visual world, for 3D graphics e.t.c. but can't think of any uses for sound applications, other than what could already be done with 2 2D webcams.

The thing seems to have a capable processor that does a lot of shape etc recognition that one would spend 50% of CPU and 2 months of coding Application wise there are no advantages over what we know already - I believe.
Did you google for loads of demos on vimeo (I think)? Have a look...

Cheers
Jurgen

ah, good point about the on board processing. I guess it may also be a neater hardware solution than the double webcam idea.

So I got Tuio Kinect + Pd working last night. Proof of concept here:

@ultrasonic said:

@arif said:

anyone have any good ideas though?

I can see how Kinect is important in the visual world, for 3D graphics e.t.c. but can't think of any uses for sound applications, other than what could already be done with 2 2D webcams.

The thing seems to have a capable processor that does a lot of shape etc recognition that one would spend 50% of CPU and 2 months of coding Application wise there are no advantages over what we know already - I believe.
Did you google for loads of demos on vimeo (I think)? Have a look...

Cheers
Jurgen

haha nice 2 meet u here. there is no vimeo no youtube in CHINA~

@JesseScott said:

So I got Tuio Kinect + Pd working last night. Proof of concept here:

finally a working example d^

@thetrincho said:

I've been tested before, with the purpose of using the iPhone motion sensor such as musical instrument, with some successes and many failures. worked with, TouchOSC+puredata+midi yoke+reason 4.0 iphone to pc
I have now, Kinect. and I see the possibilities, but not yet connected to the pc.
this week will try to connect to pure data first, then if I have success, redirect to midiyoke, and from this to, reason 4.0, or some program like ableton (all on windows xp)
I just want to operate two cameras and an infrared sensor. microphones and other things for later.
I look forward to the results that some had with web cameras and motion detection, and there is much information about the operation of Kinect, there are many people working on such devices, and youtube is full of videos with new ideas.
then look for people with dreams and desire to play with Kinect,
the possibilities are many.
and in the furture will be a great tool.
Who would want to join the team?

Hi,

I'm really interested in your work, how can I join your team ?
Where do you live ?

Cheers

Hi, PC user can try https://github.com/Sensebloom/OSCeleton with OpenNi usertracker.exe. OSCeleton send messages on port 7110, using udpreceive you can play with kinect sceleton data. Wonderfull!!

hello,

i got kinect wroking with pd via osceleton on my macbook in a few hours. it's easy and precise, and you get x,y, and z coordinates for each articulation in osc to use directly in pd. if anyone's interested, just follow this tuto

http://tohmjudson.com/?p=30

any questions please ask

cheers

@gab_lecup said:

hello,

i got kinect wroking with pd via osceleton on my macbook in a few hours. it's easy and precise, and you get x,y, and z coordinates for each articulation in osc to use directly in pd. if anyone's interested, just follow this tuto

http://tohmjudson.com/?p=30

any questions please ask

cheers

I'm followed the tutorial and got it to work in Max/msp.
which patch did you use for pd ?
is there a way to have a video image of the body tracked by osceleton ?

Thx!

hey buscon,

here's a copy of a mail i sent a friend, and the corresponding patches.
you can see these patches being used here:

(original mail)
ok here's a simplified version of the patch i use. i've just modified the "mud" patch and haven't checked it all, so there are bugs and errors everywhere, but i guess you're just interested in the abs which receive and dispatch the data from kinect.

so the kinect is received by osceleton and what i get in pd is osc messages. basically it's x, y, and z coordinates for each point of the body. so you'll be interested in the patches "kinector" and "shooter".

KINECTOR:

• it translates the osc into data that the granular sampler "mud" can understand (0 to 1 linear).
• move the horizontal sliders to chose a user and a joint.
• toggle from "value" to "CC". in X Y and Z type a sending chanel number. in the granular patch, toggle from value to CC, so you can affect a receiving chanel number for each automatisable parameter.
• hit the "learn" buton and then cover with your body the area you wish to use. this sets minimums and maximum for each axis. if you want to calibrate the whole body at ounce first select "all_joints". hit the "learn" buton again to end calibration. body motion is now active.
• the toggle on the top right activates remote sound control for the "learn" function, for if you work alone. enable it, use the vertical slider to choose the gate for incoming volume. stand at your starting point, and clap or scream. calibrate, and clap again.
• if you toggle from "abs" to "rltv", instead of calibrating the movement of each joint in absolute space it will consider their relative distance to the torso joint. the advantage of this is one movement will have the same effect wherever you are positioned in the space.
• you save, open, and load presets as textfiles on your drive. you can save presets for the whole patch on the top right of the master patch.

SHOOTER:

• basically the same as kinector, but used for one-shots instead of continuous changes.
• chose a user, a joint, an axis, and a direction
• type a chanel cumber where it says CC
• in "time", type a time in miliseconds. everytime a joint passes a chosen point in space in a chosen direction, it will output a line from 0 to 1 in the chosen time.
• calibrate in the same way. you can use "all_joints" too bu there's a huge error somewhere so if you do first toggle to "value".
• same as kinector for the rest.

ok here you go. i don't know how much you know pd, so that's why i explained as much as i could. these patches are absolutely not clean, they're my first ideas since i got the kinect, and i'm working on more to have one tight patch in the end (including speed detection, movement prevision to compensate latency, etc ... ).
ok hope this helps.

if you have trouble using the "mud" patch let me know. if you are going to use the patch, please let me know and make sure you mention it's mine.
cheers
salut

gab

http://www.pdpatchrepo.info/hurleur/upload1.zip

Hi gab_lecup,

thanks for your patches, I'm looking into them, really interesting

Do you know is there a way to have a visual response of my movements ?

Best