基于改进YOLO v5的自然环境下樱桃果实识别方法
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

山东省自然科学基金项目(ZR2020MC084)


Cherry Fruit Detection Method in Natural Scene Based on Improved YOLO v5
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为提高对樱桃果实识别的准确率,提升果园自动采摘机器人的工作效率,使用采集到的樱桃原始图像以及其搭配不同数据增强方式得到的数据图像共1816幅建立数据集,按照8∶2将数据集划分成训练集与测试集。基于深度学习网络,利用YOLO v5模型分别对不同数据增强方式以及组合增强方式扩增后的樱桃数据集进行识别检测,结果表明离线增强与在线增强均对模型精度提升有一定的正向促进作用,其中采用离线数据增强策略能够显著且稳定的增加检测精度,在线数据增强策略能够小幅度提高检测精度,同时使用离线增强以及在线增强能够最大幅度的提升平均检测精度。针对樱桃果实之间相互遮挡以及图像中的小目标樱桃检测难等导致自然环境下樱桃果实检测精度低的问题,本文将YOLO v5的骨干网络进行改动,增添具有注意力机制的Transformer模块,Neck结构由原来的PAFPN改成可以进行双向加权融合的BiFPN,Head结构增加了浅层下采样的P2模块,提出一种基于改进YOLO v5的自然环境下樱桃果实的识别网络。实验结果表明:相比于其他已有模型以及单一结构改进后的YOLO v5模型,本文提出的综合改进模型具有更高的检测精度,使平均精度均值2提高了29个百分点。结果表明该方法有效的增强了识别过程中特征融合的效率和精度,显著地提高了樱桃果实的检测效果。同时,本文将训练好的网络模型部署到安卓(Android)平台上。该系统使用简洁,用户设备环境要求不高,具有一定的实用性,可在大田环境下对樱桃果实进行准确检测,能够很好地满足实时检测樱桃果实的需求,也为自动采摘等实际应用奠定了基础。

    Abstract:

    In order to improve the accuracy of cherry fruit recognition and the working efficiency of orchard automatic picking robot, totally 1816 sets of cherry original images collected in Yantai Academy of Agricultural Sciences and data images obtained with different data enhancement methods were used to establish the data set, the data set was divided into training set and test set according to rate of 8∶2, and YOLO v5 model was used to identify and detect cherry data sets enhanced by different data enhancement methods and combined enhancement methods based on the in-depth learning network. The results showed that offline enhancement and online enhancement had a certain positive effect on the improvement of model accuracy. The offline data enhancement strategy could significantly and stably increase the detection accuracy, and the online data enhancement strategy could slightly improve the detection accuracy. Using the combination of offline enhancement and online enhancement at the same time could greatly improve the average detection accuracy. In view of the mutual occlusion between cherry fruits and the difficulty in detecting small cherry targets in the picture, the detection accuracy of cherry fruits in the natural environment was low, the backbone network of YOLO v5 was changed, the transformer module with attention mechanism was added, and the neck structure was changed from the original pafpn to bifpn which could carry out two-way weighted fusion. The P2 module of shallow down sampling was added to the head structure. The experimental results showed that compared with other existing models and the improved YOLO v5 model with a single structure, the comprehensive improved model proposed had the highest detection accuracy, and the mAP@0.5∶0.95 was increased by 2.9 percentage points. The results showed that this method effectively enhanced the efficiency and accuracy of feature fusion in the recognition process, and significantly improved the detection effect of cherry fruit. At the same time, the trained network model was deployed on the Android platform. The system was simple and clear to use, and the requirements of user equipment environment were not high. Therefore, the system had certain practicability. It could detect cherry fruit in real time and accurately in the field environment, which laid a foundation for practical applications such as automatic service picking in the future.

    参考文献
    相似文献
    引证文献
引用本文

张志远,罗铭毅,郭树欣,刘刚,李淑平,张瑶.基于改进YOLO v5的自然环境下樱桃果实识别方法[J].农业机械学报,2022,53(s1):232-240. ZHANG Zhiyuan, LUO Mingyi, GUO Shuxin, LIU Gang, LI Shuping, ZHANG Yao. Cherry Fruit Detection Method in Natural Scene Based on Improved YOLO v5[J]. Transactions of the Chinese Society for Agricultural Machinery,2022,53(s1):232-240.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-06-14
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2022-11-10
  • 出版日期: