基于运动特征提取和2D卷积的鱼类摄食行为识别研究
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

上海市崇明区农业科创项目(2021CNKC-05-06)、国家重点研发计划项目(2023YFD2401304)和上海市水产动物良种创制与绿色养殖协同创新中心项目(2021科技02-12)


Recognition of Feeding Behavior of Fish Based on Motion Feature Extraction and 2D Convolution
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为了促进渔业装备智能化,近年来基于视频流的鱼类摄食行为识别研究受到了广泛关注。针对基于视频流的传统识别方法模型过于复杂,难以在边缘计算设备部署的问题,提出了一种轻量级的2D卷积运动特征提取网络Motion-EfficientNetV2,该网络以视频流为输入,能够有效识别鱼类摄食行为。提出的模型以EfficientNetV2为主干网络,基于TEA和ECANet构建了运动特征提取模块Motion,并将该模块嵌入到EfficientNetV2的每个Fused-MBConv模块中,使改进后的EfficientNetV2具有运动特征提取能力。同时使用ECANet对EfficientNetV2网络中的MBConv进行改进,增强其通道特征提取能力。在此基础上利用空洞卷积扩大感受野,提高大范围特征提取能力。试验结果表明,Motion-EfficientNetV2的参数量和浮点运算量分别为9.3×106和1.31×1010,优于EfficientNetV2。在TSN-ResNet50、TSN-EfficientNetV2、C3D以及R3D模型上进行对比试验,本文模型在降低参数量和浮点运算量的同时,使识别准确率提高到93.97%。该研究对于渔业装备智能化升级和科学养殖具有推动作用。

    Abstract:

    In order to promote the intelligence of fishery equipment, video streaming-based fish feeding behaviour recognition has received extensive attention in recent years. The model of traditional recognition methods based on video streaming is too complex to be realized on edge computing devices. To address this problem, a lightweight 2D-convolutional motion feature extraction network, Motion-EfficientNetV2, was proposed which can effectively recognize fish feeding behaviour by using video streams as input. The proposed model used EfficientNetV2 as the backbone network, constructed the motion feature extraction module Motion based on TEA and ECANet, and embeded the Motion module into each Fused-MBConv module of EfficientNetV2, in order to give EfficientNetV2 the ability to extract motion features. The MBConv in the EfficientNetV2 network was also improved by using ECANet to enhance its channel feature extraction capability. Null convolution was used in Motion-EfficientNetV2 to expand the receptive field and improve the wide-range feature extraction capability. The experimental results showed that after introducing the designed Motion module and a series of improvements, the number of parameters and FLOPs of Motion-EfficientNetV2 was 9×106 and 1.31×1010, respectively, which were reduced compared with EfficientNetV2. Comparison experiments using the same dataset in the algorithmic models of TSN-ResNet50, TSN-EfficientNetV2, C3D, and R3D, respectively, showed that the present algorithm achieved an accuracy of 93.97% while the number of parameters and FLOPs were lower than the rest of the models. Therefore, the model proposed can effectively identify fish feeding behavior and guide aquaculturists to develop fish feeding strategies.

    参考文献
    相似文献
    引证文献
引用本文

张铮,沈彦兵,张泽扬.基于运动特征提取和2D卷积的鱼类摄食行为识别研究[J].农业机械学报,2024,55(6):246-253. ZHANG Zheng, SHEN Yanbing, ZHANG Zeyang. Recognition of Feeding Behavior of Fish Based on Motion Feature Extraction and 2D Convolution[J]. Transactions of the Chinese Society for Agricultural Machinery,2024,55(6):246-253.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-10-13
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-06-10
  • 出版日期: