StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Construction
Tianyuan Yuan, Yicheng Liu, Yue Wang et al. · IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2024
High-Definition (HD) maps are essential for the safety of autonomous driving systems. While existing techniques employ camera images and onboard sensors to generate vectorized high-precision maps, they are constrained by their reliance on single-frame input. This approach limits their stability and performance in complex scenarios such as occlusions, largely due to the absence of temporal information. Moreover, their performance diminishes when applied to broader perception ranges. In this paper, we present StreamMapNet, a novel online mapping pipeline adept at long-sequence temporal modeling of videos. StreamMapNet employs multi-point attention and temporal information which empowers the construction of large-range local HD maps with high stability and further addresses the limitations of existing methods. Furthermore, we critically examine widely used online HD Map construction benchmark and datasets, Argoverse2 and nuScenes, revealing significant bias in the existing evaluation protocols. We propose to resplit the benchmarks according to geographical spans, promoting fair and precise evaluations. Experimental results validate that StreamMapNet significantly outperforms existing methods across all settings while maintaining an online inference speed of 14.2 FPS. Our code is available at https://github.com/yuantianyuan01/StreamMapNet.
Cited by 118 works. doi:10.1109/wacv57701.2024.00719 Open-access PDF
Authors
References
- Deep Residual Learning for Image Recognition
- Exploiting Generative AI to Scale up Intelligent Tutoring Systems
- Feature Pyramid Networks for Object Detection
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- End-to-End Object Detection with Transformers
- nuScenes: A Multimodal Dataset for Autonomous Driving
- LOAM: Lidar Odometry and Mapping in Real-time
- LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain
- Deformable DETR: Deformable Transformers for End-to-End Object Detection
- Inverse perspective mapping simplifies optical flow computation and obstacle detection