基于VINS-MONO和改进YOLO v4-Tiny的果园自主寻筐方法
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家重点研发计划项目(2021YFD2000105)


Autonomous Basket Searching Method for Orchards Transporter Based on VINS-MONO and Improved YOLO v4-Tiny
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    面向果园运输车果品采收自主运输作业场景,提出了一种基于VINS-MONO和改进YOLO v4-Tiny的果园自主寻筐方法。首先基于VINS-MONO视觉惯性里程计算法,进行果园运输车位置姿态的实时估计。然后基于改进YOLO v4-Tiny目标检测算法,根据图像数据进行果筐实时目标检测并获取对应深度信息。其次根据运输车当前位置姿态、果筐深度信息以及深度相机内参,进行被识别果筐位置更新。最后基于三次B样条曲线拟合原理,以被识别果筐位置为控制点,进行寻筐路径实时拟合,为果园运输车抵近果筐提供路线引导。试验结果表明:改进YOLO v4-Tiny果筐识别模型的平均识别精度为93.96%,平均推理时间为14.7ms,4m内的果筐距离定位误差小于4.02%,果筐角度定位误差小于3°,果园运输车实测平均行驶速度为3.3km/h,果筐搜寻路线平均更新时间为0.092s,能够在果树行间和果园道路两种作业环境下稳定实现自主寻筐。该方法能够为果园运输车提供自主寻筐路径引导,为其视觉导航提供研究参考。

    Abstract:

    A method for orchard autonomous basket searching based on VINS-MONO and improved YOLO v4-Tiny was proposed for the scenario of orchard transporter fruit harvesting and autonomous transportation operations. Firstly, the position of the orchard transporter was estimated in real time based on the VINS-MONO visual inertial odometry calculation method. Then based on the improved YOLO v4-Tiny target detection algorithm, real-time target detection of the fruit basket was performed on the image data, and its depth information was obtained. Nextly, the position of the identified fruit basket was estimated based on the current position pose of the transporter, the depth information of the fruit basket and the parameters of the depth camera. Finally, based on the principle of cubic B spline curve fitting, the path of the identified fruit basket was fitted in real time, using the position of the identified fruit basket as the control point, to provide route guidance for the autonomous fruit basket search of the orchard transporter. The test results showed that the average recognition accuracy of the improved YOLO v4-Tiny fruit basket recognition model was 93.96%, the average inference time was 14.7ms, the measurement error of the fruit basket distance within 4m was less than 4.02%, the measurement error of the fruit basket angle was less than 3°, the measured driving speed of the orchard transporter was 3.3km/h,the average update time of the fruit basket search route was 0.092s, and the transporter could stably achieve autonomous basket searching in two operating environments: fruit tree rows and orchard roads. This method could provide autonomous basket finding path guidance for orchard transporter and provide research reference for visual navigation of orchard transporter.

    参考文献
    相似文献
    引证文献
引用本文

朱立成,韩振浩,赵博,周利明,王瑞雪,靳晨.基于VINS-MONO和改进YOLO v4-Tiny的果园自主寻筐方法[J].农业机械学报,2023,54(8):97-109. ZHU Licheng, HAN Zhenhao, ZHAO Bo, ZHOU Liming, WANG Ruixue, JIN Chen. Autonomous Basket Searching Method for Orchards Transporter Based on VINS-MONO and Improved YOLO v4-Tiny[J]. Transactions of the Chinese Society for Agricultural Machinery,2023,54(8):97-109.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-12-24
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-04-23
  • 出版日期: