Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Driving

Bo Jiang¹, Shaoyu Chen¹, Bencheng Liao¹, Xingyu Zhang², Wei Yin², Qian Zhang², Chang Huang², Wenyu Liu¹, Xinggang Wang^1,📧

¹ Huazhong University of Science and Technology, ² Horizon Robotics, ^📧 Corresponding Author

News

[2024-10-04]: Senna arXiv paper released. Code/Models are coming soon. Please stay tuned! ☕️

Highlights

• Senna is an autonomous driving system that integrates a Large Vision-Language Model with an end-to-end model to improve planning safety, robustness and generalization.

• Senna achieves SOTA planning performance and demonstrates strong cross-scenario generalization and transferability.

Visualizations

Acknowledgments

LLaVA, the codebase we built upon, we sincerely thank the contributors for their great work!

Citation

If you find Senna useful in your research or applications, please consider giving us a star 🌟 and citing it by the following BibTeX entry.

@article{jiang2024senna,
      title={Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Driving}, 
      author={Bo Jiang and Shaoyu Chen and Bencheng Liao and Xingyu Zhang and Wei Yin and Qian Zhang and Chang Huang and Wenyu Liu and Xinggang Wang},
      year={2024},
      eprint={2410.22313},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2410.22313}, 
}

Related Projects

VAD & VADv2, MapTR