Nvidia AI Demonstrates Insanely Fast Neural Rendering Model That Turns 2D Photos into 3D Objects in Seconds

Impressive!

"... Known as inverse rendering, the process uses AI to approximate how light behaves in the real world, enabling researchers to reconstruct a 3D scene from a handful of 2D images taken at different angles. The NVIDIA Research team has developed an approach that accomplishes this task almost instantly — making it one of the first models of its kind to combine ultra-fast neural network training and rapid rendering.
NVIDIA applied this approach to a popular new technology called neural radiance fields, or NeRF. The result, dubbed Instant NeRF, is the fastest NeRF technique to date, achieving more than 1,000x speedups in some cases. The model requires just seconds to train on a few dozen still photos  — plus data on the camera angles they were taken from — and can then render the resulting 3D scene within tens of milliseconds. ..."

Nvidia AI Demonstrates Insanely Fast Neural Rendering Model Called 'NeRF' That Turns 2D Photos into 3D Objects in Seconds - MarkTechPost

Instant NeRF is a neural rendering model that learns a high-resolution 3D scene in seconds — and can render images of that scene in a few milliseconds. Instant NeRF is a neural rendering model that learns a high-resolution 3D scene in seconds — and can render images of that scene in a few milliseconds.

NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis (open access)