Holo's picture

Hello, I work with psychomotor therapists for psychotic children and adolescents. I would like to make young autistic people draw with a kinect like a Google tilt brush in simpler form, as jersmi drawinspace did. Does anyone have a simple composition to start with? ? Good day to you Holo Bonjour, Je travaille avec des psychomotriciennes des enfants et des adolescents psychotiques. Je voudrais faire dessiner les jeunes autistes avec une kinect à la façon de Google tilt brush en plus simple comme l'a réalisé jersmi drawinspace. Quelq'un aurait-il une composition simple pour commencer? ? Bonne journée à vous Holo

Comments

You'll need two applications

jstrecker's picture
Submitted by

You'll need two applications running: (1) NI mate to input the Kinect video and output OSC messages and (2) the Vuo composition to receive OSC messages and make the graphics.

For the Vuo composition, basically you'd be combining File > Open Example > Draw in Space with File > Open Example > OSC > Track Skeleton. Or another approach to painting would be File > Open Example > Image Generator > Draw Rainbow Trail.

One tip for NI mate: If its output data is too jittery, in the NI mate Control Interface window, increase Skeleton Tracking > Settings > Smoothing.

Does that give you enough information to start with? Of course feel free to ask more questions.

Merci beaucoup Jaymie,

Holo's picture
Submitted by

Merci beaucoup Jaymie, J'ai testé Nimate fonctionne bien. J'ai testé mais je tourne en rond, à part déplacer les barre dans le bloc "diplay the control windows" Nous voudrions faire dessiner les jeunes sur une peinture de Miro à partir de différents points de jonction du squelette . Si tu pouvais me donner un exemple,j e pourrais avancer. Je te joint trois capture photos de dessins réalisés avec la sourie. Bonne journée cMiro-skeleton-DrawInSpace.zip

Merci le DrawinSace

Holo's picture
Submitted by

Merci le DrawinSace-simplified fonctionne très bien mais le DrawinSace-simplified-kinect ne trace pas de ligne .j'ai (ajustez avec zThreshold) mais aucun tracé. J'ai peut-être mal (ajustez avec zThreshold)!

If you haven't already,

jstrecker's picture
Submitted by

If you haven't already, disable hand tracking in NI mate. When I first tested the composition myself, it wasn't drawing any lines. The problem was that hand tracking was making everything extremely slow. Only enable skeleton tracking, not hand tracking.

If that doesn't fix it — Run the composition and click on the Right Hand port to open the popover. Does it show points changing as you wave your hand? If so, look at the z-coordinate of the points to calibrate zThreshold. Otherwise, click on the Receive OSC Messages node's output port and see if the composition is receiving messages from NI mate.

When you move your hand

jstrecker's picture
Submitted by

When you move your hand closer and farther from the Kinect, does the value in the Is Greater Than node's A port change? When I tested earlier today with a Kinect, I was sitting about 5 feet from the Kinect, and the values were between -0.8 and -1.2. That's why I picked -1 for zThreshold.

In your screenshots, events are not flowing as quickly as I would expect. The A port's popover says "~0.2 par seconde". I would expect something in the range of 30–90 events per second.

Does Fichier > Ouvrir l'exemple > OSC > Track Skeleton work correctly for you? It should show a sphere for each joint in the skeleton.

In Ni mate, the settings

jstrecker's picture
Submitted by

In Ni mate, the settings relevant to Vuo's Filter Skeleton node are under Kinect for Windows > User Detection > Skeleton Tracking. There, you can uncheck Hands to improve performance. Also there, under Settings, you can adjust Smoothing.

To add a background image, use Make Unlit 3D Object from Image. See Fichier > Ouvrir l'exemple > Scene > Add Noise to Clay.

When NImate sends hand and

Scratchpole's picture
Submitted by

The 'Hand' output from the vuo node is in reality the wrist position from NImate which should work adequately for your requirements. NImate can output hands with fingers if used on a Windows machine with Kinect v2.

When NImate sends hand and finger coordinates it overwhelms Vuo. (I only tested this with Kinect 360 (v1)).

There is also a bug in NImate with switching off hand tracking. NI mate sends the hands even when the tick box setting for them is off. You can force disabling them in the skeleton tracking settings as follows:

Enable the hands tick box, Clear all the OSC fields for the finger joints, Hands/Fingers will no longer be sent.

A little more info here: https://vuo.org/node/2607

I would suggest you use a Leap Motion if you would like to get acurate finger tracking for drawing.

Merci Joe.J'ai du mal à

Holo's picture
Submitted by

Merci Joe.J'ai du mal à calibrer pour dessiner avec le kinect, sur les conseil de jaymie j'ai testé avec leap motion,cela fonctionne plus simplement. J'ai repris la composition de de Steve Mokris .Paint with Brush..Jaymie pourrais -tu me modifié la composition "DrawInSpace-simplified-kinect" avec leap motion? J'ai du mal à sortir de la toile,l'image en pincement les doigts! dans la composition "Paint with Brush".