基于卷积层特征可视化的猕猴桃树干特征提取
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金项目(31971805)和陕西省科技统筹创新工程计划项目(2015KTCQ02-12)


Feature Extraction of Kiwi Trunk Based on Convolution Layer Feature Visualization
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为探究卷积层深度对猕猴桃树干图像特征提取的影响,提出了一种分析所提取特征的可视化方法。首先,对所采集建立的数据集进行正负样本分类,将数据集中的树干与输水管交叉区域作为正样本,其余区域作为负样本,输入LeNet、Alexnet、Vgg-16以及定义的3类浅层模型进行训练;然后,通过提取激活映射图、归一化、双三次插值的可视化方法,获取各个分类模型最后一个卷积层的可视化结果,通过可视化试验对比可知,Alexnet和Vgg-16能够准确提取测试集图像中的树干区域特征,而LeNet与3类浅层模型在提取树干的同时将输水管、地垄等区域特征一并提取;最后,以上述6类网络结构作为特征提取层的图像分类和目标检测模型,对开花期和结果期的数据集进行验证,以不同季节数据集特征变化而引起的精度下降幅度作为评判标准,结果显示,图像分类浅层模型精度下降幅度不小于15.90个百分点、Alexnet与Vgg-16分别下降6.94个百分点和2.08个百分点,目标检测浅层模型精度下降幅度不小于49.77个百分点、Alexnet和Vgg-16分别下降22.53个百分点和20.54个百分点。所有浅层模型因所提取特征的改变,精度有更大幅度的下降。该方法从可视化角度解释深层网络与浅层网络对猕猴桃树干目标特征的提取差异,可为研究网络深度和训练样本的调整提供参考。

    Abstract:

    In order to explore the effect of depth of convolution layer on feature extraction of kiwi trunk images, a visualization method was proposed to analyze the extracted features. Firstly, the collected data set was classified into positive and negative samples. Taking the area where the trunk and the water pipe intersected in the dataset as positive samples and the remaining areas as negative samples. Input the samples into LeNet, Alexnet, Vgg-16 and the defined three types of shallow structures for training. Then, by extracting the activation map, normalization, and bicubic interpolation visualization methods, the visualization results of the last convolution layer of each classification model were obtained. The comparison can be obtained: Alexnet and Vgg-16 extracted trunk features in the test image, while LeNet and three types of shallow models extracted the trunk, ridge and other features together while extracting the trunk. Finally, the image classification and object detection models of the above six types of network structures as feature extraction layers were used to verify the flowering period and fruiting period data sets, and the accuracy drop caused by changes in the characteristics of the data sets in different seasons was used as the evaluation criterion: the accuracy of image classification shallow model was decreased by more than 15.90 percentage points, Alexnet and Vgg-16 were decreased by 6.94 percentage points and 2.08 percentage points respectively, the accuracy of object detection shallow model was decreased by more than 49.77 percentage points, Alexnet and Vgg-16 were decreased by 22.53 percentage points and 20.54 percentage points respectively. The accuracy of all shallow models was greatly reduced due to changes in the extracted features. This method explained the difference between the feature extraction of the kiwi trunk target from the deep network and the shallow network from the perspective of visualization, and provided a reference for the adjustment of network depth and training samples in subsequent research. 

    参考文献
    相似文献
    引证文献
引用本文

崔永杰,高宗斌,刘浩洲,李凯,傅隆生.基于卷积层特征可视化的猕猴桃树干特征提取[J].农业机械学报,2020,51(4):181-190. CUI Yongjie, GAO Zongbin, LIU Haozhou, LI Kai, FU Longsheng. Feature Extraction of Kiwi Trunk Based on Convolution Layer Feature Visualization[J]. Transactions of the Chinese Society for Agricultural Machinery,2020,51(4):181-190.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2019-12-04
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2020-04-10
  • 出版日期: 2020-04-10