Comment by hjessmith

3 years ago

Hey! That’s my project!

Code and dataset are here: https://github.com/facebookresearch/AnimatedDrawings

And a browser-based version of it is here: http://sketch.metademolab.com/

28 comments

hjessmith

Reply
greggsy  3 years ago

This is really cool, and refreshingly simple in the current landscape of generative tooling.

I’m interested to hear your thoughts about the inevitable monetisation that will occur once someone wraps this into a horrible app with ads?

Maybe someone else can answer the related question of how the respective app stores deal with attribution-based code licenses?

  • hjessmith  3 years ago

    Yeah, I think that'll happen. I think it's already happening. And if someone wraps it in a terrible app with ads, makes millions of dollars, and I never see any of the money, yes I'll be very sad. But I'm trying to take a bigger perspective here. There's a lot of experience and tools that could be built off this, and I can't possibly build them all.

    And if I hid the code away so only I could use it, there's a good chance no one would ever create any of those experiences. Creating a successful app requires mobile UI people, devops, designers, marketing/SEO, monetization, etc. I don't want to do ANY of that... in the land of app creation, I'm more of a Tom Bombadil-type.

    This is also my first project out of graduate school. I feel like I'll probably have other ideas down the road, and maybe I'll try to monetize those ones with what I've learned from this adventure.

cstrat  3 years ago

This is AMAZING, my 3 year old draws the cutest pictures and I can animate them!

One thing with the browser version, it all works fine up until the animation and then its flipping my image upside down? Could this just be the photo metadata rotation/orientation??

  • hjessmith  3 years ago

    It’s not metadata, you would see that when you upload the photo at the beginning.

    I’m guessing that the nose key point is located below the shoulders in your child’s drawing?

    That’s a known issue caused by how we ‘apply’ poses onto the characters. It’s fixed in the GitHub code but not in the browser version. Try moving the nose keypoint to the top of the characters head and that should resolve it

  • eurekin  3 years ago

    Imagine future job market, where a 5 year old will already be super familiar with the T-posing, which currently mostly CG artists now about

Awelton  3 years ago

This is a really neat idea. My son got such a kick out of it that he has been drawing new characters for two hours now.

SanderNL  3 years ago

This is great fun. Thank you for giving away this work and so accessibly. I got it working in minutes.

liveoneggs  3 years ago

my kids and I had a lot of fun with the sketch version while killing time in a hotel room a while ago.

sva_  3 years ago

Would be nice to add a queue. Went through all the steps and then it said the servers are busy losing progress.

tealpod  3 years ago

Thank you Thank you Thank you, my kid loving it. I will be happy to volunteer and help in anyway I can.

qainsights  3 years ago

Cool project. Just tried with my kids. They enjoyed it. Is it possible to download the video?

  • hjessmith  3 years ago

    I assume you're referring to the demo at sketch.metademolab.com? The server is returning an .mp4 file that is displayed by your browser, so you should be able to download it. On Chrome, if I maximize the video and click the three vertical dots, I get the option to download the video.

  • Knucklebones  3 years ago

    On the online demo, you can also download by clicking 'share' at the end (there's an option in the menu that shows up).

doubtfuluser  3 years ago

This is really a fun project!

Is it actually possible to use the code and create an app for sale out of it. The MIT license says so I think, just wondering if anything else would speak against it.

  • hjessmith  3 years ago

    I don't know who would speak out against it. The MIT license certainly allows for it, and I don't actually own it... I just wrote it :)

    • ac50hz  3 years ago

      +1

      This is a pleasant take. I may borrow the sentiment expressed here to help me describe some similar distinctions.