Comment by hellohello2

There are some works on doing this directly e.g. https://arxiv.org/abs/2601.23065 but getting accurate materials is a challenge for anything more than diffuse.

AI-based relighting will no doubt start working soon.