高级检索

    基于AI异源图像匹配与多模态数据融合的视觉导航技术

    Visual Navigation Technology Based on AI Heterogeneous Image Matching and Multimodal Data Fusion

    • 摘要: 随着计算机视觉技术的发展成熟,视觉传感器已成为各类型无人机标配。在传统惯性/GNSS组合导航基础上引入视觉导航辅助,从视觉图像提供的丰富环境信息和载体运动信息中获取载体位姿信息,可有效解决GNSS拒止情形下高精度导航问题。提出了一种新型融合视觉、IMU与GIS地图的多模态导航增强技术,通过异源图像匹配AI模型(SuperPoint+SuperGlue)实现实时航拍图与基准卫星图的精准匹配,并结合卡尔曼滤波完成多模态数据融合,实验结果表明在100~1 000 m低空,GNSS信号失效时,系统定位精度误差小于5 m(RMSE)。

       

      Abstract: With the development and maturity of computer vision technology, visual sensors have become standard equipment for various types of UAVs. Introducing visual navigation assistance on the basis of traditional inertial/GNSS integrated navigation, and obtaining carrier pose information from the rich environmental information and carrier motion information provided by visual images, can effectively solve the problem of high-precision navigation in GNSS-denied scenarios. A novel multimodal navigation enhancement technology integrating vision, IMU and GIS map is proposed in this paper. The AI model for heterogeneous image matching (SuperPoint+SuperGlue) is used to achieve accurate matching between real-time aerial images and reference satellite images, and Kalman filtering is combined to complete multimodal data fusion. Experimental results show that in low-altitude environments of 100~1 000 m with GNSS signal failure, the system positioning accuracy error is less than 5 m (RMSE).

       

    /

    返回文章
    返回