Skip to content

Curated list of papers and resources focused on implicit slam mapping, main focused on Nerf and 3d gaussian based slam

License

Notifications You must be signed in to change notification settings

LeihanChen/awesome_gaussian_slam

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

18 Commits
Β 
Β 
Β 
Β 

Repository files navigation

Awesome Gaussian SLAM Resources

A curated list of papers and open-source resources focused on gaussian based slam system, focusing on slam systems with gaussian based mapping representation with any utilities. The ambition is keeping pace with the anticipated surge of research in the coming months. If you have any additions or suggestions, feel free to contribute. Additional resources like blog posts, videos, etc. are also welcome.

Table of contents



Update Log:
**July 11, 2024** - Initial version
**July 16, 2024** - Add survey and theory sections
**August 9, 2024** - Add relevant papers and viewers
**September 27, 2024** - Add relevant papers, reorganize sections
**November 07, 2024** - Add relevant papers, add 3d generation section

Introduction:

Nerf:

3D Gaussian Splatting:


Survey:

  • Scene reconstruction techniques for autonomous driving: a review of 3D Gaussian splatting, Zhu et al., Artificial Intelligence Review 2024 | πŸ“„ Paper

  • A Survey on 3D Gaussian Splatting, Chen et al., arXiv 2024 | πŸ“„ Paper

  • How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Survey, Tosi et al., arXiv 2024 | πŸ“„ Paper

  • 3D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunities, Chen et al., TPAMI 2024 | πŸ“„ Paper🌐 Project Page

  • 3D Gaussian as a New Vision Era: A Survey, Fei et al., arXiv 2024 | πŸ“„ Paper

  • Recent Advances in 3D Gaussian Splatting, Wu et al., arXiv 2024 | πŸ“„ Paper

  • Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Review, Dalal et al., arXiv 2024 | πŸ“„ Paper

Gaussian Theory:

Gaussian SLAM:

2024:

2023:


Navigation:

2024:

  • GaussNav: Gaussian Splatting for Visual Navigation, Lei et al., arXiv 2024 | πŸ“„ Paper | 🌐 Project Page | πŸ’» Code

  • 3DGS-ReLoc: 3D Gaussian Splatting for Map Representation and Visual ReLocalization, Jiang et al., arXiv 2024 | πŸ“„ Paper

  • Beyond Uncertainty: Risk-Aware Active View Acquisition for Safe Robot Navigation and 3D Scene Understanding with FisherRF, Liu et al., arXiv 2024 | πŸ“„ Paper

  • 3DGS-Calib: 3D Gaussian Splatting for Multimodal SpatioTemporal Calibration, Herau et al., arXiv 2024 | πŸ“„ Paper

  • [CVPR '24] HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting Zhou et al., arXiv 2024 | πŸ“„ Paper | 🌐 Project Page| πŸ’» Code

  • HO-Gaussian: Hybrid Optimization of 3D Gaussian Splatting for Urban Scenes, Li et al., arXiv 2024 | πŸ“„ Paper

  • SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior, Yu et al., arXiv 2024 | πŸ“„ Paper

Poses:

2024:

Large-Scale:

2024:

3D Reconstruction:

2024:

Gaussian Surfel:

2024:

2023:

Theory:

  • Surfels: Surface Elements as Rendering Primitives, Pfister et al., CGIT 2000 | πŸ“„ Paper

Surfel based SLAM:

3D Generations:

2024:

Data


Courses


Open Source Implementations

Unofficial Implementations

Language License
Taichi 3D Gaussian Splatting taichi Apache-2.0
Gaussian Splatting 3D Python/CUDA
3D Gaussian Splatting Python/CUDA MIT
fast C++/CUDA Inria/MPII
nerfstudio Python/CUDA Apache-2.0
taichi-splatting taichi/PyTorch Apache-2.0
OpenSplat C++/CPU or GPU AGPL-3.0
3D Gaussian Splatting Python/CUDA MIT
Grendel Distributed 3DGS Python/CUDA Apache-2.0
[GauStudio]https://github.com/GAP-LAB-CUHK-SZ/gaustudio) Python/CUDA MIT

2D Gaussian Splatting

Gaussian Style Transfer

Game Engines

Viewers

Utilities

  • Kapture - A unified data format to facilitate visual localization and structure from motion e.g. for bundler to colmap model conversion
  • Kapture image cropper script - Undistorted image cropper script to remove black borders with included conversion instructions
  • camorph - A toolbox for conversion between camera parameter conventions e.g. Reality Capture to colmap model
  • 3DGS Converter - A tool for converting 3D Gaussian Splatting .ply files into a format suitable for Cloud Compare and vice-versa
  • SuperSplat - Open source browser-based tool to clean/filter, reorient and compress .ply/.splat files
  • SpectacularAI - Conversion scripts for different 3DGS conventions
  • GSOPs - GSOPs (Gaussian Splat Operators) for SideFX Houdini. Import, edit, and export models, or generate synthetic training data

Tutorial

Framework

  • msplat - A modular differential gaussian rasterization library.
  • GauStudio - Unified framework with different paper implementations
  • gaussian-splatting-lightning - A 3D Gaussian Splatting framework with various derived algorithms and an interactive web viewer
  • gsplat - Part of the NerfStudio project, a 3D Gaussian Splatting framework with various derived algorithms and an interactive web viewer.

Other

Blog Posts

  1. Gaussian Splatting is pretty cool
  2. Making Gaussian Splats smaller
  3. Making Gaussian Splats more smaller
  4. Very good (technical) intro to 3D Gaussian Splatting
  5. Write up on some mathematical details of the 3DGS implementation
  6. Discussion about gs universal format
  7. Math explanation to understand 3DGS
  8. Compressing Gaussian Splats
  9. Comprehensive overview of Gaussian Splatting
  10. Gaussian Head Avatars: A Summary
  11. NeRFs vs. 3DGS
  12. Howto capture images for 3DGS
  13. Mathematical details of forward and backward passes
  14. 3D in Geospatial: NeRFs, Gaussian Splatting, and Spatial Computing
  15. NeRFs vs. 3DGS Comprehensive Overview

Tutorial Videos

  1. Getting Started with 3DGS for Windows
  2. How to view 3DGS Scenes in Unity
  3. Jupyter notebook tutorial
  4. Intro to gaussian splatting (and Unity plugin)
  5. Comprehensive 3DGS explanation

Credits

Most credits should be contributed to Awesome 3D Gaussian Splatting, 3D Gaussian Splatting Papers

About

Curated list of papers and resources focused on implicit slam mapping, main focused on Nerf and 3d gaussian based slam

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published