基于RGB-D相机的黄瓜苗3D表型高通量测量系统研究
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家重点研发计划项目(2019YFD1001900)、HZAU-AGIS交叉基金项目(SZYJY2022006)、湖北省重点研发计划项目(2021BBA239)和中央高校基本科研业务费专项资金项目(2662022YLYJ010)


High-throughput Measurement System for 3D Phenotype of Cucumber Seedlings Using RGB-D Camera
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    传统的人工种苗表型测量方式存在效率低、主观性强、误差大、破坏种苗等问题,提出了一种使用RGB-D相机的黄瓜苗表型无损测量方法。研制了自动化多视角图像采集平台,布署两台Azure Kinect相机同时拍摄俯视和侧视两个视角的彩色、深度、红外和RGB-D对齐图像。使用Mask R-CNN网络分割近红外图像中的叶片和茎秆,再与对齐图进行掩膜,消除了对齐图中的背景噪声与重影并得到叶片和茎秆器官的对齐图像。网络实例分割结果的类别和数量即为子叶和真叶的数量。使用CycleGAN网络处理单个叶片的对齐图,对缺失部分进行修补并转换为3D点云,再对点云进行滤波实现保边去噪,最后对点云进行三角化测量叶面积。在Mask R-CNN分割得到的茎秆对齐图像中,利用茎秆的近似矩形特征,分别计算茎秆的长和宽,再结合深度信息转换为下胚轴长和茎粗。使用YOLO v5s检测对齐图中的黄瓜苗生长点,利用生长点与基质的高度差计算株高。实验结果表明,该系统具有很好的通量和精度,对子叶时期、1叶1心时期和2叶1心时期的黄瓜苗关键表型测量平均绝对误差均不高于8.59%、R2不低于0.83,可以很好地替代人工测量方式,为品种选育、栽培管理、生长建模等研究提供关键基础数据。

    Abstract:

    The traditional method of artificial seedling phenotype measurement has some problems, such as low efficiency, strong subjectivity, large error and damaged seedlings. A method for nondestructive detection of cucumber seedling phenotype by using the RGB-D camera was proposed. An automated multi-view image acquisition platform was developed, and two Azure Kinect cameras were deployed to simultaneously capture color, depth, NIR, and RGB-D images from the top view and side view. The Mask R-CNN network was used to segment the leaves and stems in the NIR image, and then mask them with the RGB-D image to eliminate the background noise and ghost in the RGB-D images and obtain the RGB-D image of the leaves and stems. The category and number of segmentation results of the Mask R-CNN network were the numbers of cotyledons and true leaves. The CycleGAN network was used to process the RGB-D image of a single leaf, repair the missing and convert it into 3D point clouds, and then filter the point clouds to achieve edge-preserving denoising. Finally, the point clouds were triangulated to measure the leaf area. In the stem RGB-D image obtained by Mask R-CNN segmentation, the approximate rectangular feature of the stem was used to calculate the length and width of the stem respectively, and then the depth information was combined to convert the hypocotyl length and stem diameter. YOLOv5s was used to detect the growing point of cucumber seedlings in the RGB-D image, and the height difference between the growing point and the substrate was used to calculate the plant height. The experimental results showed that the system had good flux and accuracy. The mean absolute errors of key phenotypes of cucumber seedlings at cotyledon, 1 true-leaf and 2 true-leaf stages were all no more than 8.59% and R2 was no less than 0.83, which can well replace the manual measurement method, and provide key basic data for seed selection and breeding, cultivation management, growth modeling, and other research.

    参考文献
    相似文献
    引证文献
引用本文

徐胜勇,李磊,童辉,王成超,别之龙,黄远.基于RGB-D相机的黄瓜苗3D表型高通量测量系统研究[J].农业机械学报,2023,54(7):204-213,281. XU Shengyong, LI Lei, TONG Hui, WANG Chengchao, BIE Zhilong, HUANG Yuan. High-throughput Measurement System for 3D Phenotype of Cucumber Seedlings Using RGB-D Camera[J]. Transactions of the Chinese Society for Agricultural Machinery,2023,54(7):204-213,281.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-10-27
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-07-10
  • 出版日期: