They found a new NeRF technique to turn videos into controllable 3D models

What if there was a way to create 3D animated models of humans right from video footage?

Figure 1: Synthesized images of the hand wave sequence in novel view and novel pose.

Creating realistic, animated 3D models from video footage has been a longstanding challenge in the field of computer graphics due to the complexity of human movement and the subtleties of appearance under varying conditions. Traditionally, this process has relied on cost…