Skip to content

Latest commit

 

History

History
372 lines (301 loc) · 41.6 KB

README.md

File metadata and controls

372 lines (301 loc) · 41.6 KB
Raw

Awesome Neural Radiance Fields (NeRF) Awesome

A curated list of awesome neural radiance fields (NeRF) papers. All papers are grouped according to keywords/tasks, and sorted by year. We hope this review can help peers who are interested in conducting NeRF related research.

Contributing

Warmly welcome everyone to participate in this project!!! If you are interested in joining our team and organizing NeRF related papers/codes/projects together, please submit PR according to the following guide. We'll put your name on the list of contributors.

Submit a Pull Request

Table of Contents

Papers

Year Conf/Jour Code Title OtherInfo
2020 ECCV TF Torch NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis Project Page

Survey

Year Conf/Jour Code Title OtherInfo
2022 Computer Graphics Forum Advances in Neural Rendering
2022 - NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review
2022 Computer Graphics Forum Neural Fields in Visual Computing and Beyond
2020 Computer Graphics Forum State of the Art on Neural Rendering

NeRF

Data Augmentation

Year Conf/Jour Code Title OtherInfo
2022 ECCV GeoAug: Data Augmentation for Few-Shot NeRF with Geometry Constrains
2022 ECCV Torch Neural-Sim: Learning to Generate Training Data with NeRF
2022 CVPR Torch Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations

Few Shot

Year Conf/Jour Code Title OtherInfo
2022 NeurIPS TF D^2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video Project Page
2022 ECCV Comming Soon ActiveNeRF: Learning where to See with Uncertainty Estimation
2022 ECCV GeoAug: Data Augmentation for Few-Shot NeRF with Geometry Constrains
2022 ECCV Torch SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image Project Page
2022 CVPR Dense Depth Priors for Neural Radiance Fields from Sparse Input Views
2022 CVPR TF RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputs
2022 CVPR AutoRF: Learning 3D Object Radiance Fields from Single View Observation Project Page
2022 CVPR Torch InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering
2022 CVPR Torch Depth-supervised NeRF: Fewer Views and Faster Training for Free
2021 ICCV Torch Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis Project Page
2021 ICCV Torch Neural Radiance Flow for 4D View Synthesis and Video Processing
2021 ICCV Torch MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo Project Page
2021 CVPR Torch pixelNeRF: Neural Radiance Fields from One or Few Images Project Page

Rendering Performance

Year Conf/Jour Code Title OtherInfo
2022 arXiv JAX MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architectures Project Page
2022 NeurIPS Torch Compressible-composable NeRF via Rank-residual Decomposition
2022 NeurIPS Neural Transmitted Radiance Fields
2022 ECCV Torch TensoRF: Tensorial Radiance Fields Project Page
2022 ECCV Jax NeXT: Towards High Quality Neural Radiance Fields via Multi-Skip Transformer
2022 ECCV Torch R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis Project Page
2022 ECCV Gaussian Activated Neural Radiance Fields for High Fidelity Reconstruction & Pose Estimation
2022 ECCV Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantification
2022 ECCV Torch ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers
2022 ECCV Gaussian Activated Neural Radiance Fields for High Fidelity Reconstruction & Pose Estimation
2022 CVPR Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields
2022 CVPR Urban Radiance Fields
2022 CVPR Torch GeoNeRF: Generalizing NeRF with Geometry Priors Project Page
2022 CVPR NeRFReN: Neural Radiance Fields with Reflections
2022 CVPR Torch Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations
2021 ICCV Torch GNeRF: GAN-based Neural Radiance Field without Posed Camera
2021 ICCV Torch UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction
2021 ICCV Torch MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis
2021 ICCV TF Nerfies: Deformable Neural Radiance Fields Project Page

Theory

Year Conf/Jour Code Title OtherInfo
2020 ECCV TF Torch NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis

Training & Inference Efficiency

Year Conf/Jour Code Title OtherInfo
2022 ACM TOG Code Instant Neural Graphics Primitives with a Multiresolution Hash Encoding Project Page
2022 ECCV Torch R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis Project Page
2022 ECCV Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering
2022 ECCV Torch ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers
2022 ECCV Torch AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fields
2022 CVPR Torch Point-NeRF: Point-based Neural Radiance Fields
2022 CVPR Torch DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering
2022 CVPR Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-time
2022 CVPR Torch Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction Project Page
2022 CVPR Torch EfficientNeRF – Efficient Neural Radiance Fields
2022 CVPR Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
2021 ICCV TF Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
2021 ICCV Torch PlenOctrees for Real-time Rendering of Neural Radiance Fields Project Page
2021 ICCV Torch KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs
2021 ICCV TF Baking Neural Radiance Fields for Real-Time View Synthesis Project Page
2021 CVPR TF DeRF: Decomposed Radiance Fields Project Page

NeRF Related Tasks

Deblur & Denoise

Year Conf/Jour Code Title OtherInfo
2022 CVPR Torch Deblur-NeRF: Neural Radiance Fields from Blurry Images
2022 CVPR NAN: Noise-Aware NeRFs for Burst-Denoising Project Page
2022 CVPR NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images

Depth Estimation

Year Conf/Jour Code Title OtherInfo
2022 CVPR AR-NeRF: Unsupervised Learning of Depth and Defocus Effects from Natural Images with Aperture Rendering Neural Radiance Fields Project Page
2021 ICCV Torch NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo
2021 ICCV Torch MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis

Editing

Year Conf/Jour Code Title OtherInfo
2022 NeurIPS Torch DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes Project Page
2022 NeurIPS Decomposing NeRF for Editing via Feature Field Distillation Project Page
2022 NeurIPS CageNeRF: Cage-based Neural Radiance Field for Generalized 3D Deformation and Animation
2022 ECCV Comming Soon Deforming Radiance Fields with Cages Project Page
2022 ECCV Torch MoFaNeRF: Morphable Facial Neural Radiance Field
2022 ECCV Torch PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo Project Page
2022 ECCV Torch NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing Project Page
2022 CVPR Torch DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering
2022 CVPR Jittor NeRF-Editing: Geometry Editing of Neural Radiance Fields
2022 CVPR Torch FENeRF: Face Editing in Neural Radiance Fields
2022 CVPR RigNeRF: Fully Controllable Neural 3D Portraits
2022 CVPR CoNeRF: Controllable Neural Radiance Fields
2021 ICCV Torch Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering Project Page
2021 ICCV Torch Editing Conditional Radiance Fields Project Page
2021 CVPR Torch GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields Project Page
2021 CVPR Torch Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondence
2021 NeurIPS Torch Geometry Processing with Neural Fields Project Page

Face

Year Conf/Jour Code Title OtherInfo
2022 NeurIPS Generative Neural Articulated Radiance Fields
2022 ECCV Torch Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis Project Page
2022 ECCV Torch Injecting 3D Perception of Controllable NeRF-GAN into StyleGAN for Editable Portrait Image Synthesis
2022 ECCV Torch MoFaNeRF: Morphable Facial Neural Radiance Field
2022 ECCV Torch Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields Project Page
2022 CVPR LOLNeRF: Learn from One Look Project Page
2022 CVPR Torch FENeRF: Face Editing in Neural Radiance Fields
2022 CVPR CoNeRF: Controllable Neural Radiance Fields
2022 CVPR Torch HeadNeRF: A Real-time NeRF-based Parametric Head Model
2022 CVPR Torch Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to NeuralRadiance Fields Translation
2021 ICCV Torch AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
2021 CVPR Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction Project Page

High Dynamic Range (HDR)

Year Conf/Jour Code Title OtherInfo
2022 ECCV Comming Soon HDR-Plenoxels: Self-Calibrating High Dynamic Range Radiance Fields
2022 CVPR HDR-NeRF: High Dynamic Range Neural Radiance Fields

Human

Year Conf/Jour Code Title OtherInfo
2022 NeurIPS Generative Neural Articulated Radiance Fields
2022 ECCV Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering
2022 ECCV Torch KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypoints Project Page
2022 ECCV Torch NeuMan: Neural Human Radiance Field from a Single Video
2022 CVPR Structured Local Radiance Fields for Human Avatar Modeling
2022 CVPR Torch Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesis
2022 CVPR Torch HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video
2022 CVPR DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Rendering
2021 ICCV Torch Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies Project Page
2021 ICCV Torch Neural Articulated Radiance Field
2021 ACM TOG Editable Free-Viewpoint Video using a Layered Neural Representation

Image Generation

Image Generation
Year Conf/Jour Code Title OtherInfo
2022 CVPR Torch Efficient Geometry-aware 3D Generative Adversarial Networks Project Page
2020 NeurIPS Torch GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis
Text & Image Guided Generation
Year Conf/Jour Code Title OtherInfo
2022 ECCV Torch Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields Project Page
2022 CVPR Code CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields

Large Scale Scene

Year Conf/Jour Code Title OtherInfo
2022 ECCV Torch NeRF for Outdoor Scene Relighting Project Page
2022 CVPR Urban Radiance Fields
2022 CVPR Torch NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction
2022 CVPR Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs
2022 CVPR Block-NeRF: Scalable Large Scene Neural View Synthesis
2022 CVPR Torch Hallucinated Neural Radiance Fields in the Wild
2021 ICCV Torch Unconstrained Scene Generation with Locally Conditioned Radiance Fields Project Page
2021 CVPR NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections Project Page

Pose Misalignment

Year Conf/Jour Code Title OtherInfo
2021 ICCV BARF: Bundle-Adjusting Neural Radiance Fields Project Page

Reinforcement Learning

Year Conf/Jour Code Title OtherInfo
2022 NeurIPS Reinforcement Learning with Neural Radiance Fields Project Page

Relighting

Year Conf/Jour Code Title OtherInfo
2022 ECCV Torch NeRF for Outdoor Scene Relighting Project Page
2022 ACM MM Factorized and Controllable Neural Re-Rendering of Outdoor Scene for Photo Extrapolation Project Page
2021 CVPR TF NeRD: Neural Reflectance Decomposition from Image Collections Project Page
2021 CVPR NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis
2021 ACM TOG TF NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination Project Page

Segmentation

Year Conf/Jour Code Title OtherInfo
2022 NeurIPS Unsupervised Multi-View Object Segmentation Using Radiance Field Propagation
2022 NeurIPS TF D^2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video Project Page
2022 NeurIPS Decomposing NeRF for Editing via Feature Field Distillation Project Page
2022 ECCV LaTeRF: Label and Text Driven Object Radiance Fields

Stylized

Year Conf/Jour Code Title OtherInfo
2022 ECCV Torch ARF: Artistic Radiance fields Project Page
2022 CVPR Jittor StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning
2021 ICCV Torch Learning to Stylize Novel Views Project Page

Surface Reconstruction

Year Conf/Jour Code Title OtherInfo
2021 ICCV Torch UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction
2021 NeurIPS Torch NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction Project Page
2021 NeurIPS Volume Rendering of Neural Implicit Surfaces

Video

Year Conf/Jour Code Title OtherInfo
2022 NeurIPS Torch DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes Project Page
2022 ECCV Torch NeuMan: Neural Human Radiance Field from a Single Video
2021 ACM TOG TF HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields Project Page
2021 CVPR Torch D-NeRF: Neural Radiance Fields for Dynamic Scenes
2021 ICCV Torch Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Video
2021 CVPR Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction Project Page
2021 CVPR Learning Compositional Radiance Fields of Dynamic Human Heads Project Page
2021 CVPR Space-time Neural Irradiance Fields for Free-Viewpoint Video Project Page

View Synthesis Extrapolation

Year Conf/Jour Code Title OtherInfo
2022 CVPR Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolation

Unclassified

Year Conf/Jour Code Title OtherInfo
2022 ECCV BungeeNeRF: Progressive Neural Radiance Field for Extreme Multiscale Scene Rendering
2022 CVPR Neural Volumetric Object Selection Project Page
2021 ICCV Torch CodeNeRF: Disentangled Neural Radiance Fields for Object Categories
2021 ICCV Torch Self-Calibrating Neural Radiance Fields

Datasets

Year Name Related Paper Task Instances Note
2022 PeRFception PeRFception: Perception using Radiance Fields 2D classification, 3D classification, 3D segmentation 19k
2021 NeuS-DATA NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction Surface Reconstruction -
2020 NeRF-DATA NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis View Synthesis - Benchmark

Talks

Year Theme Speaker/Publisher Language
2022 TensoRF: Tensorial Radiance Fields Zexiang Xu EN
2022 ECCV2022 - Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis Shens EN
2022 [NeRF-OSR, ECCV 2022] NeRF for Outdoor Scene Relighting Vlad Golyanik (4DQV) EN
2022 PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo (ECCV 2022) Yoo EN
2022 [ECCV 2022] KeypointNeRF: Generalizing Image-based Volumetric Avatars Marko Mihajlovic EN
2022 [ECCV'22] Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields Yuedong Chen EN
2022 [CVPR 2022] Neural Volumetric Object Selection Jason Ren EN
2022 [ACM-MM'22] Factorized and Controllable Neural Re-Rendering of Outdoor Scene for Photo Extrapolation Bangbang Yang EN
2021 Geometry Processing with Neural Fields Guandao Yang EN
2021 Editing Conditional Radiance Fields Steven Liu EN
2021 Michael Niemeyer: Generative Neural Scene Representations 3D Representation Seminar Yen-Chen Lin EN
2021 NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination Xiuming Zhang EN
2020 NeRD: Neural Reflectance Decomposition from Image Collections Mark Boss EN
2020 NeRF: Neural Radiance Fields Matthew Tancik EN

Acknowledgment

When we reviewed the literatures about NeRF, we found that this excellent repo had not been updated for a long time, so we reorganized and released our awesome-NeRF. Some features were borrowed from repo, so we are grateful for their works.

Team

Team Members

Zhongwei Qiu (Leader), Zijiang Yang, Tianle Cheng

Contributors

Hutao99999, Tyler Luan