← Back to context

Comment by Tade0

1 day ago

I would like to see how the fight scenes in The Beginning After the End could improve from being passed through this tool.

In all seriousness I wonder where is this all headed? Are people long term going to be more forgiving of visual artifacts if it will mean that their favourite franchise gets another season? Or will generated imagery be shunned just like the not-so-subtle use of 3D models?

    Toei Animation is looking to utilize AI in areas such as
    storyboarding, coloring, and “color specification,” as
    well as in-between animation and backgrounds.

    The specific use cases mentioned include:
    • Storyboarding: Leveraging AI to “generate simple
      layouts and shooting of the storyboards.”
    • Colors: Employing AI to “specify colors and
      automatically correct colors.”
    • In-betweens: Utilizing AI to “automatically correct
      line drawings and generate in-betweens.”
    • Backgrounds: Using AI to “generate backgrounds from
      a photo.”

Source: https://www.japannihon.com/toei-animation-discusses-ai-use-i...

I think this is fine. The director will still make sure there's no visual artifacts. On the other hand indies will be able to create their own works, maybe with some warts, but better than nothing.

We're discussing the implications of this here when this has presented nothing novel in this medium/genre? I gave it a shot and it still has the same pitfalls for video genAI. Dealing with chains of dynamic actions is the biggest challenge, moreso with anime with its several fight scenes. No, it did not do good, and none of the non open-source models can do a good job of it for the most part either