融合多光谱成像与深度学习的作物植株叶绿素检测系统研究
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

山东省重点研发计划(重大科技创新工程)项目(2022CXGC020708-1)、国家自然科学基金项目(31971785)和中国农业大学教改项目(JG202026、QYJC202101、JG202102、BH2022176)


Fusing Multispectral Imaging and Deep Learning in Plant Chlorophyll Index Detection System
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为了满足田间作物长势快速检测与指导变量管理的需求,以玉米为例设计了基于多光谱成像的田间作物植株叶绿素检测系统,包括可见光(RGB)和近红外(Near-infrared, NIR)图像采集模块、主控处理器模块、模型加速模块、显示及电源模块,用于实现玉米植株智能识别与叶绿素指标一体化检测。首先,采集玉米苗期和拔节期冠层图像数据集,比较了植株冠层实例分割与株心目标检测两种深度学习模型,构建了基于MobileDet+SSDLite(Single-shot multibox detector lite)轻量化网络的玉米植株定位检测模型,实现玉米植株识别。其次,提取被识别的植株株心RGB-NIR图像,开展RGB和NIR图像匹配与分割,提取R、G、B和NIR灰度值计算植被指数,使用SPXY算法(Sample set portioning based on joint X-Y distances)和连续投影算法(Successive projections algorithm,SPA)分别对数据集进行样本划分及特征变量筛选,选择高斯过程回归(Gaussian process regression,GPR)算法建立叶绿素指标检测模型。结果显示,玉米株心目标检测模型在遮挡重叠的复杂环境下识别率达到88.7%,在不交叉重叠时识别精度达到90%以上;叶绿素含量指标检测模型建模集的模型决定系数R2为0.62,测试集模型决定系数R2为0.61。对开发系统进行田间测试,结果显示,系统检测速率可达14.6f/s,平均精度为92.9%。研究结果能够有效解决大田环境下玉米营养状态的检测问题,满足大田环境实时检测需求,为作物生产智慧感知提供解决思路和技术支持。

    Abstract:

    In order to meet the needs of rapid detection of field crop growth and guiding variable management, a field crop chlorophyll intelligent detection system based on multi-spectral imaging was designed and developed with maize as an example. It included visible light (RGB) and near-infrared (NIR) image acquisition module, main control processor module, model acceleration module, display and power module, which was used to realize intelligent identification of corn plants and integrated detection of chlorophyll index. Firstly, the canopy image data set of maize seedling stage and jointing stage were collected, and two deep learning models of plant canopy instance segmentation and plant center target detection were compared. A corn plant location detection model based on MobileDet+SSDLite (single shot multibox detector lite) lightweight network was constructed to realize corn plant identification. Secondly, the identified plant heart RGB-NIR images were extracted, the matching and segmentation of RGB and NIR images were carried out, and the gray values of R, G, B and NIR were extracted to calculate the vegetation index. SPXY algorithm (sample set portioning based on joint X-Y distances) and SPA (successive projections algorithm) were used. The samples of the dataset were divided and the characteristic variables were screened, and then GPR (Gaussian process regression) algorithm was selected to establish the chlorophyll index detection model. The results showed that the recognition rate of the model reached 88.7% in the complex environment of occlusion overlap, and the recognition accuracy reached more than 90% in the non-overlapping environment. The model determination coefficient R2 of the modeling set of the chlorophyll content index detection model was 0.62, and the model determination coefficient R2 of the test set was 0.61. Field tests on the developed system showed that the detection rate of the system can reach 14.6 frames per second, and the average accuracy was 92.9%. The research results can effectively solve the problem of corn nutritional status detection in field environment, meeting the real-time detection requirements of field environment, and providing solutions and technical support for intelligent perception of crop production.

    参考文献
    相似文献
    引证文献
引用本文

王楠,李震,李佳盟,张源,孙红,李民赞.融合多光谱成像与深度学习的作物植株叶绿素检测系统研究[J].农业机械学报,2023,54(s2):260-269. WANG Nan, LI Zhen, LI Jiameng, ZHANG Yuan, SUN Hong, LI Minzan. Fusing Multispectral Imaging and Deep Learning in Plant Chlorophyll Index Detection System[J]. Transactions of the Chinese Society for Agricultural Machinery,2023,54(s2):260-269.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-06-20
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-08-30
  • 出版日期: