Skip to content

FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry

Notifications You must be signed in to change notification settings

hku-mars/FAST-LIVO2

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 

Repository files navigation

FAST-LIVO2

FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry

📢 News

  • 🎉 2024-10-01: Accepted by T-RO '24!
  • 🚀 2024-07-02: Conditionally accepted.

📬 Contact

If you have any questions, please feel free to contact: Chunran Zheng [email protected].

1. Related video

Our accompanying video is now available on Bilibili and YouTube.

2. Related paper

FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry

FAST-LIVO: Fast and Tightly-coupled Sparse-Direct LiDAR-Inertial-Visual Odometry

3. Codes & Datasets & Application

Our paper is currently undergoing peer review. The code, dataset, and application will be released once the paper is accepted.

4. Preview

This section showcases representative results of FAST-LIVO2 with high-resolution screenshots, allowing for easier observation of details.

4.1 Online point cloud mapping results (Partial)

All sequences in FAST-LIVO2 private dataset are captured using low-cost Livox Avia LiDAR + pinhole camera.

CBD_Building_03

"CBD Building 03" sequence (severe LiDAR and camera degeneration)

Retail_Street

"Retail Street" sequence

Bright_Screen_Wall

"Bright Screen Wall" sequence (severe LiDAR degeneration)

HIT_Graffiti_Wall_01 HIT_Graffiti_Wall_02

"HIT Graffiti Wall" sequence (severe LiDAR degeneration)

HKU_Centennial_Garden

"HKU Centennial Garden" sequence

SYSU_01

"SYSU 01" sequence

Banner_Wall CBD_Building_02

Left: "Banner Wall" sequence (severe LiDAR degeneration), Right: "CBD Building 02" sequence (severe LiDAR degeneration)

HKU_Landmark HKUST_Red_Sculpture

Left: "HKU Landmark" sequence, Right: "HKUST Red Sculpture" sequence

Mining_Tunnel_01

"Mining Tunnel" sequence (severe LiDAR and camera degeneration)

HKisland01_2 HKisland01

"HKisland01" sequence

HKairport01 HKairport01_2

"HKairport01" Sequence (LiDAR degeneration)

4.2 Mesh and texture reconstruction based on our dense colored point clouds

mesh

(a) and (b) are the mesh and texture mapping of “CBD Building 01”, respectively. (c) is the texture mapping of “Retail Street”, with (c1) and (c2) showing local details.

4.3 Gaussian Splatting based on our dense colored point clouds

nerf

Comparison of ground-truth image, COLMAP+3DGS, and FAST-LIVO2+3DGS in terms of render details, computational time (time for generating point clouds and estimating poses + training time), and PSNR for a random frame in “CBD Building 01”.

4.4 Fully Onboard Autonomous UAV Navigation

We mark a pioneering instance of employing a LiDAR-inertial-visual system for real-world autonomous UAV flights. Our UAV, equipped with LiDAR, a camera, and an inertial sensor, performs online state estimation (i.e., FAST-LIVO2), trajectory planning, and tracking control, all managed entirely by its onboard computer.

uav_exp1

(a) shows the overall point map of the "Basement" experiment. In (a1)-(a4), white points indicate the LiDAR scan at that moment, and colored lines depict the planned trajectory. (a1) and (a4) mark areas of LiDAR degeneration. (a2) and (a3) show obstacle avoidance. (a5) and (a6) depict the camera first-person view from indoor to outdoor, highlighting large illumination variation from sudden overexposure to normal.

uav_exp2

(a) and (b) show the enlarged point maps of the "Woods" and "Narrow Opening" experiments, respectively. The red points in (a1), (a3), and (b4) represent the LiDAR scan at that moment. (a2) and (a4) represent the first-person view at the corresponding locations. (b1)-(b3) depict the third-person view.