基于点线特征融合改进IMU初始化的双目视觉惯性SLAM方法
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金项目(52565057)、云南省基础研究计划项目(202301AU070059)和云南彩云博士后项目


Binocular Vision SLAM Algorithm for Improving IMU Initialization Based on Point-line Feature Fusion
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对基于特征点的SLAM系统在弱纹理场景下存在特征提取不足、易跟踪丢失等问题,为提高在复杂场景中的系统初始化精度和鲁棒性,本文在ORB SLAM3框架的基础上加入了线特征,并对视觉惯性初始化进行了改进。首先在前端视觉里程计部分融入了LSD算法和LBD描述子进行线特征的提取和匹配,建立点、线特征重投影误差模型,并用基于非线性优化的BA方法来最小化重投影误差,同时引入自适应因子动态调整线特征权重。接着通过扩展双目MNEC约束构建陀螺仪偏差估计器,采用旋转平移解耦优化策略,并引入残差评估机制确保视觉惯性初始化可靠性,同时将IMU残差、特征点重投影误差以及直线重投影误差共同作为非线性优化的约束条件对相机位姿进行估计。在euroc数据集和真实场景中进行实验,结果表明与改进前ORB SLAM3算法相比,在数据集下改进算法定位精度提高22.9%,真实环境中偏移量减少1.4 m,从而验证了改进算法的可行性和有效性。

    Abstract:

    Aiming at the problems of insufficient feature extraction and easy tracking loss of feature point-based SLAM systems in texture-less scenarios, as well as improving the initialization accuracy and robustness of the system in challenging scenarios, the line features on the basis of the ORB SLAM3 framework were incorporated and the visual inertia initialization was improved. Firstly, the LSD algorithm and LBD descriptor were incorporated into the front-end visual odometry part for line feature extraction and matching, the point and line feature reprojection error models were established, and the BA method based on nonlinear optimization was used to minimize the reprojection error, while the adaptive factor was introduced to dynamically adjust the weights of the line features. Then the gyroscope bias estimator was constructed by extending the binocular MNEC constraints, adopting the rotation-translation decoupling optimization strategy and introducing the residual evaluation mechanism to ensure the reliability of visual inertia initialization, while the IMU residuals, the feature point reprojection errors, and the line reprojection errors were jointly used as the constraints of nonlinear optimization for the estimation of the camera position. Experiments were conducted in the euroc dataset and real scenes, and the results showed that compared with the pre-improved ORB SLAM3 algorithm, the improved algorithm improved the localization accuracy by 22.9% under the dataset and reduced the offsets by 1.4 m in the real environment, thus verifying the feasibility and effectiveness of the improved algorithm.

    参考文献
    相似文献
    引证文献
引用本文

陈久朋,杨旺,伞红军,冯金祥,伞亮.基于点线特征融合改进IMU初始化的双目视觉惯性SLAM方法[J].农业机械学报,2026,57(5):373-386. CHEN Jiupeng, YANG Wang, SAN Hongjun, FENG Jinxiang, SAN Liang. Binocular Vision SLAM Algorithm for Improving IMU Initialization Based on Point-line Feature Fusion[J]. Transactions of the Chinese Society for Agricultural Machinery,2026,57(5):373-386.

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-07-19
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-03-01
  • 出版日期:
文章二维码