Comment by zokier
1 year ago
could be interesting concept to try to make some heuristics for picking which frame to use; just blindly picking always the latest frame is unlikely to be ideal, instead you might want to pick frames where there is little movement, or no ongoing animations, or some other similar metrics. if you want to be super fancy, you could try to do this analysis per-window and then construct some sort of aggregate for the whole frame.
> you could try to do this analysis per-window and then construct some sort of aggregate for the whole frame
This seems like it could get into the area of smartphone "cameras" that do so much computation on the output of the light sensors that it can hardly be called photography [0]. It's a cool idea (in chess I've heard a similar idea called "quiescence search"[1]), but probably not worth the trouble.
[0] https://old.reddit.com/r/Android/comments/11nzrb0/samsung_sp...
[1] https://en.wikipedia.org/wiki/Quiescence_search
I think this may defeat the purpose of minimal compute utilisation.
It definitely sounds like a great idea and an interesting problem.
oh, I like it actually! I had idea to scan the screen with 5-10 pixel sparse 100x100 matrix at the point where the change has been found previously to detect a possible screen change.