AI & Neural Radiance Fields (NeRFs) - Light fields are an area of interest of mine. Am working on my own NeRF setup, but don't have anything ready to post yet. Came across this very interesting demonstration of dynamic NeRFs guided by textual prompts.
The future of 3D lightfield imaging utilizing AI is going to be incredible!
I've predicted for years that this will revolutionize video(/movie) production.
As one of my favourite youtube channels often repeats: "Imagine this just two papers down the line!"
2minute papers -
https://www.youtube.com/watch?v=j8tMk-GE8hY
Why NeRFs will replace Photogrammetry techniques -
https://www.youtube.com/watch?v=-UEHhjuEXco
Default Cube's videon on create datasets (using Instant NGP) -
https://www.youtube.com/watch?v=VsFHX8IgX1o
More in-depth on how NeRFs work -
https://www.youtube.com/watch?v=CRlN-cYFxTk
Reddit Link to video:
https://www.reddit.com/r/MachineLearn...
Information and Links from Reddit post:
"We propose a method for editing NeRF scenes with text-instructions. Given a NeRF of a scene and the collection of images used to reconstruct it, our method uses an image-conditioned diffusion model (*InstructPix2Pix) to iteratively edit the input images while optimizing the underlying scene, resulting in an optimized 3D scene that respects the edit instruction. We demonstrate that our proposed method is able to edit large-scale, real-world scenes, and is able to accomplish more realistic, targeted edits than prior work. instruct-nerf2nerf.github.io"
*InstructPix2Pix: https://www.timothybrooks.com/instruc...
**github: https://instruct-nerf2nerf.github.io/
0 Comments