SoylentNews
SoylentNews is people
https://soylentnews.org/

Title    This AI Creates Detailed 3D Renderings from Thousands of Tourist Photos
Date    Sunday August 30 2020, @11:13AM
Author    Fnord666
Topic   
from the no-need-to-actually-go-there dept.
https://soylentnews.org/article.pl?sid=20/08/29/2335209

takyon writes:

This AI Creates Detailed 3D Renderings from Thousands of Tourist Photos

A team of researchers at Google have come up with a technique that can combine thousands of tourist photos into detailed 3D renderings that take you inside a scene... even if the original photos used vary wildly in terms of lighting or include other problematic elements like people or cars.

The tech is called "NeRF in the Wild" or "NeRF-W" because it takes Google Brain's Neural Radiance Fields (NeRF) technology and applies it to "unstructured and uncontrolled photo collections" like the thousands of tourist photos used to create the demo you see below[1][2], and the samples in the video above[3].

It's basically an advanced, neural network-driven interpolation that manages to include geometric info about the scene while removing 'transient occluders' like people or cars and smoothing out changes in lighting.

[1] demo1.gif (36.75 MiB)
[2] demo2.gif (35.66 MiB)
[3] YouTube video (3m42s).

NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections (arXiv:2008.02268v2 [cs.CV])


Original Submission

Links

  1. "takyon" - https://soylentnews.org/~takyon/
  2. "This AI Creates Detailed 3D Renderings from Thousands of Tourist Photos" - https://petapixel.com/2020/08/11/this-ai-creates-detailed-3d-renderings-from-thousands-of-tourist-photos/
  3. "a technique" - https://nerf-w.github.io/
  4. "demo1.gif (36.75 MiB)" - https://petapixel.com/assets/uploads/2020/08/demo1.gif
  5. "demo2.gif (35.66 MiB)" - https://petapixel.com/assets/uploads/2020/08/demo2.gif
  6. "YouTube video (3m42s)" - http://www.youtube.com/watch?v=yPKIxoN2Vf0
  7. "NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections" - https://arxiv.org/abs/2008.02268
  8. "Original Submission" - https://soylentnews.org/submit.pl?op=viewsub&subid=43143

© Copyright 2023 - SoylentNews, All Rights Reserved

printed from SoylentNews, This AI Creates Detailed 3D Renderings from Thousands of Tourist Photos on 2023-06-18 16:45:10