基于双目视觉的田间作物高度和收割边界信息提取
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

上海市科技兴农项目(沪农科推字(2019)第4-3号)、江苏省现代农机装备与技术示范推广项目(NJ2019-27)和江苏大学农业装备学部项目


Extraction of Crop Height and Cut-edge Information Based on Binocular Vision
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为实现收获机无人驾驶自适应调控,提出一种基于双目视觉对田间作物高度和收割边界信息进行提取的方法。利用双目相机获取三维数据,基于RANSAC算法拟合初始地面平面,结合IMU计算作业实时平面,根据点到平面的距离将三维数据转换为对应的实际高度。提出一种改进的结合密度峰聚类和K均值聚类的方法对高度数据分类,同时基于归一化彩色图像分割作物上部区域,融合高度分类和彩色图像分割结果,实现作物高度信息的提取。利用高度数据序列和模型函数的互相关性提取收割边界点,基于最小二乘法拟合边界直线,根据当前边界线预测下一帧数据边界点的候选范围,由收割边界直线计算航向偏差和横向偏差。实验表明,该方法可以有效提取作物高度和收割边界信息,高度检测平均绝对误差为0.043m,边界识别正确率93.30%,航向偏差平均误差为1.04°,横向偏差平均绝对误差为0.084m,对联合收获机无人驾驶自适应调控有应用价值。

    Abstract:

    Crop height and cut-edge are important factors to be considered in unmanned rice wheat combine harvester, because the height of sowing wheel is adjusted according to the crop height and cut-edge provides navigation information. Therefore, field crop height and cut-edge information were extracted based on binocular vision. The 3D data and RGB image were acquired by binocular camera. The 3D data on the flat ground were filtered by voxels and through filters, and the filtered data was fitted to the initial plane by RANSAC algorithm. The real-time plane of harvesting operation was calculated with posture changes of harvester reflected by IMU data, and the 3D data was transformed into the actual height according to the distance from point to plane. An improved method combining density peak clustering and K-means clustering was proposed to classify the height data. At the same time, the RGB image was normalized and then segmented by Otsu algorithm to extract the upper region of crop. The common region of the cluster with the largest cluster center value and the upper crop region were obtained, and the mean value of the height data belonging to the common region was calculated to obtain the crop height. Based on the cross-correlation between the height data series and the model function, the cut-edge points were extracted. The cut-edge points were fitted to the cut-edge line by the least square method. According to the current boundary line, the candidate range of the next frame data cut-edge points was predicted. The heading deviation and lateral deviation were calculated by the cut-edge line. Experiments showed that this method could effectively extract the crop height and cut-edge information, and the mean absolute error of height was 0.043m and the correct rate of boundary recognition was 93.30% under the complex harvest scenes including sparse, missed cutting and rutting. The average angle error of heading deviation was 1.04°, and the average absolute error of lateral deviation was 0.084m. Therefore, the method had application value to unmanned self-adaptive control of combine harvester.

    参考文献
    相似文献
    引证文献
引用本文

魏新华,张敏,刘青山,李林.基于双目视觉的田间作物高度和收割边界信息提取[J].农业机械学报,2022,53(3):225-233. WEI Xinhua, ZHANG Min, LIU Qingshan, LI Lin. Extraction of Crop Height and Cut-edge Information Based on Binocular Vision[J]. Transactions of the Chinese Society for Agricultural Machinery,2022,53(3):225-233.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2021-03-24
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2022-03-10
  • 出版日期: