基于RGB-D相机的苹果疏果期幼果与果柄识别定位方法
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

新疆生产建设兵团科技合作计划项目(2022BC007)和兵团英才青年项目


Recognition and Localization Method of Young Fruit and Fruit Stalk in Apple Fruit Thinning Period Based on RGB-D Cameras
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    苹果疏果作业中,幼果尺寸量化判断与果柄精准疏除位置定位是制约智能化疏除作业的核心难题,而以幼果轴向、径向尺寸及果柄直径为依据的智能化疏除技术亟待突破。为此,提出了一种基于RGB D 融合几何约束的苹果疏果期幼果及果柄三维识别定位与尺寸测量方法。首先,通过在YOLO v8 模型中引入卷积注意力融合模块(CAFM)与SIoU 损失函数,构建YOLO YF 检测模型,并结合Mask R CNN 实现幼果及果柄的高精度分割。其次,利用D435i 型深度相机完成RGB D 图像对齐与三维坐标转换,建立幼果与果柄的空间从属关系判别算法。实验结果表明:YOLO YF 模型在幼果簇检测中实现86. 80% 的精确率、78. 70% 的召回率及84. 40% 的mAP50;MaskR CNN 精确率为91. 20%,交并比为80. 94%,可有效区分果柄与叶柄;在三维尺寸测量中,幼果径向、轴向尺寸均方根误差分别为1. 43、1. 28 mm,果柄疏除位置定位误差为1. 20 mm。本研究为智能化疏果装备提供了“尺寸量化-位置定位”的技术路径。

    Abstract:

    Accurate quantification of young fruit dimensions and precise localization of thinning points on fruit stalks represented core challenges for intelligent apple fruit thinning. To address this, a 3D recognition and sizing method integrating RGB D data with geometric constraints was developed for young apples and fruit stalks during the thinning period. The YOLO v8 architecture was enhanced through integration of a convolutional attention fusion module (CAFM) and adoption of the SIoU loss function, yielding the proposed YOLO YF detection model. Mask R-CNN was subsequently employed for high-precision instance segmentation of young fruits and fruit stalks. RGB-D image acquisition was performed by using an Intel RealSense D435i depth camera, followed by rigorous image alignment and 3D coordinate transformation. A spatial subordination discrimination algorithm based on geometric features was established to determine fruit stalk relationships. Experimental validation demonstrated that the YOLO-YF model achieved 86.80% precision, 78.70% recall, and 84.40% mAP50 in clustered young fruit clusters detection. Mask R-CNN attained 91.20% segmentation precision and 80.94% IoU, enabling reliable differentiation between fruit stalks and petioles. In 3D measurements, root mean square errors ( RMSE) of 1.43mm (radial) and 1.28 mm (axial) were obtained for young fruits. The positioning error at the optimal thinning point (fruit stalk midpoint) was constrained to 1.20 mm. This approach can provide a technical pathway characterized by quantitative sizing and millimeter-level positioning accuracy for intelligent thinning equipment. The methodology demonstrated extensibility to clustered fruit management applications.

    参考文献
    相似文献
    引证文献
引用本文

陈金成,潘峰,王佰伟,张景,纪超.基于RGB-D相机的苹果疏果期幼果与果柄识别定位方法[J].农业机械学报,2026,57(5):177-185. CHEN Jincheng, PAN Feng, WANG Baiwei, ZHANG Jing, JI Chao. Recognition and Localization Method of Young Fruit and Fruit Stalk in Apple Fruit Thinning Period Based on RGB-D Cameras[J]. Transactions of the Chinese Society for Agricultural Machinery,2026,57(5):177-185.

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-07-10
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-03-01
  • 出版日期:
文章二维码