针对番茄单果采收的梗部采摘位姿估计方法
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

山东省重点研发计划项目(2023CXGC010715)和中国机械工业集团有限公司科技专项(ZDZX2023-2)


Peduncle Harvesting Pose Estimation Method for Single-fruit Tomato Harvesting
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    精准估计番茄梗部采摘位姿,是实现番茄低损、高效采摘的关键环节。番茄果梗较细且生长姿态多样,使得对番茄的切梗式单粒采收较难实现。针对以上问题,本研究提出一种结合实例分割与点云分析的番茄梗部采摘位姿估计方法。构建了番茄果实果梗实例分割数据集,并通过模型训练与评估选用性能较为均衡的YOLO v8s-seg模型对番茄果实果梗进行实例分割。对模型预测的果梗区域提取骨骼线中点作为采摘点,并通过对果梗骨骼线对应的空间点云进行直线拟合确定果梗生长方向,能够使采摘末端垂直于果梗剪切的采摘位姿。在果实像素区域内通过计算果实着红面积占比判断果实成熟度,并结合贪心匹配方法将果实与果梗进行配对,以实现选择性采收。在温室环境下搭建番茄采摘试验平台并进行了采摘位姿估计试验,结果表明,所训练的实例分割模型在测试集上掩膜预测的精确率、召回率和平均精度均值分别为85.2%,80.6%和86.9%。试验结果表明,成熟度识别准确率为97.17%,果实果梗匹配方法匹配成功率为92.25%。对朝前生长果簇,果梗与果实总体检出率分别为93.63%和96.36%,采摘点识别准确率与位姿估计准确率分别为96.11%和89.32%,综合到达采摘点的成功率为60.91%。研究所提出的方法在切梗式番茄粒采任务中具有可行性,为温室环境下的番茄采摘机器人自主作业提供了参考。

    Abstract:

    Accurate estimation of the harvesting pose of tomato peduncles is critical for achieving low-damage, high-efficiency robotic harvesting. The slender structure and diverse growth orientations of tomato peduncles make single-fruit harvesting via peduncle cutting particularly challenging. A method for estimating the harvesting pose of tomato peduncles was proposed by combining instance segmentation and point cloud analysis. Firstly, a dataset for instance segmentation of tomato fruits and peduncles was constructed. The YOLO v8s-seg model, demonstrating balanced performance during evaluation, was then selected for segmenting tomato fruits and peduncles. Nextly, the midpoints of the skeleton lines in the predicted peduncle regions were extracted as harvesting points. A linear fitting process was applied to the spatial point cloud corresponding to the peduncle skeleton lines to determine the peduncle growth direction, thereby generating a harvesting pose that aligned the end-effector perpendicular to the peduncle. Additionally, the ripeness of the fruit was determined by calculating the percentage of red area within each fruit's segmented region, and a greedy matching method was used to pair fruits and peduncles to enable selective harvesting. A tomato harvesting experimental platform was set up to validate the harvesting pose estimation method in a greenhouse. Experimental results showed that the trained instance segmentation model achieved a precision, recall, and mAP of 85.2%, 80.6%, and 86.9% on the test set, respectively. The accuracy of the proposed ripeness recognition method reached 97.17%, and the success rate of the fruit-peduncle matching method was 92.25%. For forward-growing fruit clusters, the detection rates of peduncles and fruits were 93.63% and 96.36%, respectively. The harvesting point identification and pose estimation accuracies were 96.11% and 89.32%, respectively, with an overall success rate of reaching the harvesting point of 60.91%. The proposed method demonstrated feasibility for peduncle-cutting tomato harvesting tasks, providing a reference for autonomous operation of tomato-picking robots in greenhouse environments.

    参考文献
    相似文献
    引证文献
引用本文

董力中,朱立成,赵博,王瑞雪,韩振浩,高建波,鹿昆磊,冯旭光,周利明.针对番茄单果采收的梗部采摘位姿估计方法[J].农业机械学报,2026,57(6):238-248. DONG Lizhong, ZHU Licheng, ZHAO Bo, WANG Ruixue, HAN Zhenhao, GAO Jianbo, LU Kunlei, FENG Xuguang, ZHOU Liming. Peduncle Harvesting Pose Estimation Method for Single-fruit Tomato Harvesting[J]. Transactions of the Chinese Society for Agricultural Machinery,2026,57(6):238-248.

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-11-06
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-04-15
  • 出版日期:
文章二维码