Comment by simple10

3 years ago

This is amazing!

It's a bit buried in the repo readme files, but the author @hjessmith used Rokoko Video [1] to create the animation files (BVH) from a phone video. Then he used Animated Drawings to make the drawings replicate his motion captured from the video.

Both Rokoko and Animated Drawings were new to me. I know what I'll be doing with my kids all weekend! Thanks for sharing the project.

[1] https://www.rokoko.com/products/video

Completely tangential point - Rokoko Video is fine for a free tool, but if you need something better and you're willing to pay, there are other options. I spent a couple of days evaluating various video-only mocap and in the end went with DeepMotion.

Rokoko Video wasn't very reliable (at one point I was standing perfectly still, but it thought I was on one leg twirling like a ballerina). Although it's very expensive, DeepMotion has been great (also if you were disappointed by DeepMotion 12+ months ago like I was, I'd suggest revisiting - it's leaps and bounds ahead of the earlier version I tried out).

move.ai looks very good too, but needs multiple cameras which was overkill for my use case. Plask seems to have regressed (the platform seems like it doesn't even work half the time) and Radical's aggressive tactics really turned me off.

  • It looks like DeepMotion has a free tier. Did you just need more credits or is there some additional feature only available on the paid tiers?

    • The free tier only gives you 60 seconds of animation per month, and also isn't licensed for commercial use. Even for a hobbyist, 60 seconds wont go far!

If you post your creation to social media, please use #FAIRAnimatedDrawings. I'd love to see what you create!