基于3D视觉的番茄授粉花朵定位方法
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

宁夏回族自治区重点研发项目(2018BBF02024、2018BBF02011)


Positioning Method of Tomato Pollination Flowers Based on 3D Vision
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为了给设施番茄授粉机器人授粉提供可靠的定位技术,提出了一种基于3D视觉的番茄花朵定位方法。采用RGB-D结构光相机快速获取温室内番茄植株的彩色图和深度图信息,通过YOLO v4 (You only look once)神经网络对植株上番茄花束进行目标检测,并提取出授粉花束在图像中的二维区域;使用主动对齐方式结合PCL进行彩色图像和深度图像的粗对齐,利用区域内色系单视角线性遍历方法对提取的花束区域进行精配准,获得番茄花束的空间高精度点云信息;再使用统计滤波法剔除点云信息离群点后,结合双向均值法计算花束3D box的授粉质心坐标。定位试验结果表明,该方法在温室环境中能成功对花束进行识别定位,神经网络平均检测精度达97.67%,完成单幅图像花束提取时间为14.95ms,算法获取授粉质心坐标的平均时间约为300ms。后期在温室内验证,在花束被遮挡小于80%时,算法能够对番茄花朵进行精准定位,并成功执行授粉动作,为番茄授粉机器人提供了一种新的授粉点定位方法。

    Abstract:

    In order to provide reliable positioning technical guidance for the implementation of pollination by the facility tomato pollination robot, a method for positioning tomato pollination flowers was proposed based on 3D vision. Firstly, the RGB-D structured light camera was used to quickly obtain the color map and depth map information of the tomato plants in the glass greenhouse, through the fast small target detection YOLO v4 (You only look once) neural network to detect the tomato bouquet on the plant, and extract the two-dimensional area of the pollination bouquet. Then an active alignment method was used in conjunction with PCL to roughly align the RGB map and the depth map. In the RGB image, the bouquet area was filled with yellow flowers. The color system of the pixels in the prediction frame was judged, the non-flower pixels was removed, and the precise alignment of the point cloud of the bouquet area was performed. In order to obtain the high-precision point cloud information of the spatial tomato bouquet, a single-view linear traversal method of the color system within the region was used to perform fine registration on the extracted bouquet region, in the three-dimensional point cloud collection, the double-plane centroid algorithm was used to obtain the spatial point cloud coordinates of the target bouquet (x, y, z). Finally, after the group filtering method denoised the point cloud information, the two-way average method was combined to calculate the pollination centroid coordinates of the bouquet 3D box. The positioning test results showed that the method can successfully identify and locate the bouquet in the greenhouse environment, the average detection accuracy of the neural network was 97.67%, the extraction time of a single image bouquet was 14.95ms, the time and energy consumption of the algorithm to obtain the pollination centroid coordinates was about 300ms. In the actual verification process, in the absence of strong light, the algorithm can basically realize the robot's positioning problem of tomato flowers in the greenhouse, and provide a method for the tomato pollination robot to locate and solve the pollination point.

    参考文献
    相似文献
    引证文献
引用本文

文朝武,龙洁花,张宇,郭文忠,林森,梁晓婷.基于3D视觉的番茄授粉花朵定位方法[J].农业机械学报,2022,53(8):320-328. WEN Chaowu, LONG Jiehua, ZHANG Yu, GUO Wenzhong, LIN Sen, LIANG Xiaoting. Positioning Method of Tomato Pollination Flowers Based on 3D Vision[J]. Transactions of the Chinese Society for Agricultural Machinery,2022,53(8):320-328.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2021-07-21
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2021-10-14
  • 出版日期: