Awesome-Implicit-NeRF-Robotics

This repo contains a curative list of Implicit Representations and NeRF papers relating to Robotics/RL domain, inspired by awesome-computer-vision

Please feel free to send me pull requests or email to add papers!

If you find this repository useful, please consider citing and STARing this list. Feel free to share this list with others!

For an overview of NeRFs, checkout the Survey (Neural Volume Rendering: NeRF And Beyond), Blog post (NeRF Explosion 2020) and Collection (awesome-NeRF)

---

Overview

• Object Pose Estimation
• SLAM
• Manipulation/RL
• Planning/Navigation
• Citation

---

Object Pose Estimation

• ShAPO 🎩: Implicit Representations for Multi Object Shape Appearance and Pose Optimization, ECCV, 2022. [Paper] [Webpage] [Video]

• iNeRF: "Inverting Neural Radiance Fields for Pose Estimation", IROS, 2021. [Paper] [Pytorch Code] [Website] [Dataset]

• NeRF-Pose: " A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimation", arXiv. [Paper]

• SNAKE: " SNAKE: Shape-aware Neural 3D Keypoint Field", arXiv. [Paper] [Pytorch Code]

---

SLAM

• iSDF: Real-Time Neural Signed Distance Fields for Robot Perception, RSS, 2022. [Paper] [Pytorch Code] [Website]

• LENS: " LENS: Localization enhanced by NeRF synthesis", CORL, 2021. [Paper]

• NICE-SLAM: "Neural Implicit Scalable Encoding for SLAM", CVPR, 2021. [Paper] Pytorch Code] [Website]

• iMAP: "Implicit Mapping and Positioning in Real-Time", ICCV, 2021. [Paper] [Website]

• BNV-Fusion: "BNV-Fusion: Dense 3D Reconstruction using Bi-level Neural Volume Fusion", CVPR, 2022. [Paper] Pytorch Code]

---

Manipulation/RL

• Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation, arXiv. [Paper] [Pytorch Code] [Website]

• NeRF-RL: "Reinforcement Learning with Neural Radiance Fields", arXiv. [Paper] [Website]

• Dex-NeRF: "Using a Neural Radiance Field to Grasp Transparent Objects", CORL, 2021. [Paper] [Website]

• NeRF-Supervision: "Learning Dense Object Descriptors from Neural Radiance Fields", ICRA, 2022. [Paper] Pytorch Code [Website]

• GIGA: "Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations", RSS, 2021. [Paper] [Pytorch Code] [Website]

---

Planning/Navigation

• NeRFlow: "Neural Radiance Flow for 4D View Synthesis and Video Processing", ICCV, 2021. [Paper] [Pytorch Code] [Website]

• NeRF-Navigation: "Vision-Only Robot Navigation in a Neural Radiance World", ICRA, 2022. [Paper] [Pytorch Code] [Website]

• NeRF-dy: "3D Neural Scene Representations for Visuomotor Control", CORL, 2021. [Paper] [Website]

• CompNeRFdyn: "Learning Multi-Object Dynamics with Compositional Neural Radiance Fields", arXiv. [Paper] [Website]

• PIFO: "Deep Visual Constraints: Neural Implicit Models for Manipulation Planning from Visual Input", arXiv. [Paper] [Website]

• RedSDF: "Regularized Deep Signed Distance Fields for Reactive Motion Generation", arXiv. [Paper] [Website]

• ESDF: "Sampling-free obstacle gradients and reactive planning in Neural Radiance Fields", arXiv. [Paper]

• "Full-Body Visual Self-Modeling of Robot Morphologies", arXiv. [Paper] Pytorch Code Website

---

Citation

If you find this repository useful, please consider citing this list:

@misc{irshad2022implicitnerfroboticspaperslist,
    title = {Awesome-Implicit-NeRF-Robotics},
    author = {Muhammad Zubair Irshad},
    journal = {GitHub repository},
    url = {https://github.com/zubair-irshad/Awesome-Implicit-NeRF-Robotics},
    year = {2022},
}