Motion Tracking - ML5 with ZIM

Just spent the afternoon working with ML5 with ZIM. Goodness, it was so easy. Why did we not do this years ago! I kept telling people, if you want hand tracking, face tracking, body tracking, etc. use TensorFlow. ML5 is based on TensorFlow and makes it easier. That is what P5js is using. But, I never went there myself to see.

image

https://zimjs.com/ml5

Will take a look at bringing the ml5 into perhaps the cam module so we can just import cam.

5 Likes

WOW!!! that so great!
But https://unpkg.com/ml5@1/dist/ml5.min.js didn't load in the html

Strange - it does for us - try just the URL do you see it?

We added a callback (modelLoaded) to the first picture one - maybe it was needed? Not sure, like I said, worked for us without it but on the cam ones, it did not work unless we added the callback. So try again, and if anyone has problems, let us know.

Hmmm... ml is 4mb minified so perhaps we will not automatically add it with the cam module. There is probably an es6 module or just use it as a script tag.

1 Like

Added a pinch example https://zimjs.com/ml5/pinch.html

image

We may internalize some of this

2 Likes

waauw so cool @abstract a dream comes true..