← Back to context

Comment by _kb

7 months ago

Outside of AV1/2 (and linear media in general) that's already well and truly developed tech. Nvidia DLSS, AMD FSR and Intel XeSS all provide spatial/temporal super sampling to process lower fidelity base renders [0].

There also seems to be a fair bit of attention on that problem space from the real-time comms vendors with Cisco [1], Microsoft [2] and Google [3] already leaning on model based audio codecs. With the advantages that provides both around packet loss mitigation and shifting costs to end user (aka free) compute and away from central infra I can't see that not extending to the video channel too.

[0]: https://mtisoftware.com/understanding-ai-upscaling-how-dlss-...

[1]: https://www.webex.com/gp/webex-ai-codec.html

[2]: https://techcommunity.microsoft.com/blog/microsoftteamsblog/...

[3]: https://research.google/blog/lyra-a-new-very-low-bitrate-cod...