← Back to context

Comment by hn3ufz62f7

10 hours ago

Having built something similar with CLIP on an M1, frame sampling rate is the whole ballgame. One frame a second on 12k videos is days, keyframes only got me to an overnight run.

Maybe you need a minimal downscale version as well, I heard is very common technique in the video editing world.

Based on my experience, sampling rate can be tricky if what you are looking for lasted less than interval period.

  • Proxies. You transcode proxies from the original media, edit off those, then you use OM for the final render. NLE’s usually let you flip between them.

Have you tried scene detection? I would guess camera cuts are even less frequent than keyframes.