Comment by nickandbro
16 hours ago
This could be the future of film. Instead of prompting where you don't know what the model will produce, you could use fine-grained motion controls to get the shot you are looking for. If you want to adjust the shot after, you could just checkpoint the model there, by taking a screenshot, and rerun. Crazy.
I feel like people are already currently doing this. Essentially storyboarding first.
This guy a month ago for example: https://youtu.be/SGJC4Hnz3m0