基于EnlightenGAN图像增强的自然场景下苹果检测方法
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家重点研发计划项目(2019YFD1002401)


Application of Image Enhancement Technology Based on EnlightenGAN in Apple Detection in Natural Scenes
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    自然光照下阴影会降低采摘机器人视觉系统对苹果目标的准确感知能力,导致采摘效率低。本研究采用EnlightenGAN算法进行图像增强,以实现阴影的去除和苹果目标检测精度的提升。首先通过图像光照归一化处理得到自正则化注意力图,达到图像阴影检测的目的,再采用注意力引导的U-Net作为生成器骨干网络得到增强后的图像,然后通过全局-局部判别器来比对图像信息,最终在生成器和判别器的对抗中达到图像质量增强的效果。为了进一步检验该方法的阴影去除效果,分别采用EnlightenGAN、Zero_DCE、Adaptive_GAMMA、RUAS等算法在MinneApple公共数据集上进行试验验证。结果表明,EnlightenGAN算法均方误差较Zero_DCE、Adaptive_GAMMA、RUAS算法分别降低19.21%、59.47%、67.42%,峰值信噪比增加6.26%、34.55%、47.27%,结构相似度提高2.99%、23.21%、68.29%。同时,在对果园拍摄的苹果图像进行标注后,将其送入YOLO v5m目标检测网络进行苹果检测训练。并对EnlightenGAN算法增强前后的苹果图像进行了测试,图像增强前后检测精确率分别为97.38%、98.37%,召回率分别为74.74%、91.37%,F1值分别为84%、94%,精确率、召回率和F1值分别提升1.02%、22.25%、11.90%。为证明模型有效性,对不同数据集进行了试验,结果表明EnlightenGAN算法增强后的目标检测精确率、召回率和F1值较无增强算法及Zero_DCE、Adaptive_GAMMA、RUAS算法有显著提升。由此可知,将EnlightenGAN算法应用于苹果采摘机器人的视觉系统,可以有效克服果园图像光照不均以及存在阴影的影响,提升果实目标检测性能。该研究可为自然条件下复杂光照环境中的果实检测提供借鉴。

    Abstract:

    Under natural light conditions, the presence of shadows reduced the accurate perception ability of apple harvesting robot towards apple targets, leading to low picking efficiency. Therefore, an EnlightenGAN algorithm for image enhancement was proposed, which effectively improved the accuracy of shadow removal and apple object detection. This algorithm first obtained a self-regularized attention map through image lighting standardization to achieve image shadow detection. Next, an attention-guided U-Net was used as the backbone network of the generator to obtain the enhanced image. Then, the information before and after enhancement was compared using a global-local discriminator, and image enhancement was ultimately achieved in the confrontation between the generator and discriminator. To further evaluate the effectiveness of the proposed method, EnlightenGAN, Zero_DCE, Adaptive_GAMMA, and RUAS algorithms were tested on the publicly available MinneApple dataset. Compared with Zero_DCE, Adaptive_GAMMA, and RUAS algorithms, the MSE of EnlightenGAN algorithm was decreased by 19.21%, 59.47%, and 67.42%, respectively, while the PSNR was increased by 6.26%, 34.55%, and 47.27%, respectively. The SSIM was increased by 2.99%, 23.21%, and 68.29%, respectively. The detection P of EnlightenGAN algorithm before and after enhancement were 97.38% and 98.37%, respectively, with R of 74.74% and 91.37%. The F1 score were 84% and 94%, respectively. The precision, recall, and F1 score were improved by 1.02%, 22.25%, and 11.90%, respectively. In order to verify the effectiveness of the model, different datasets were tested, and the results showed that the target detection precision, recall and F1 score after the enhancement of the EnlightenGAN algorithm were improved compared with the non enhanced algorithm, Zero_DCE, Adaptive_GAMMA and RUAS algorithms. All results indicated that the proposed method can effectively improve the detection precision under uneven lighting conditions and provide reference for the visual system of apple harvesting robot.

    参考文献
    相似文献
    引证文献
引用本文

宋怀波,杨涵茹,苏晓薇,周昱宏,高昕怡,尚钰莹,张姝瑾.基于EnlightenGAN图像增强的自然场景下苹果检测方法[J].农业机械学报,2024,55(8):266-279. SONG Huaibo, YANG Hanru, SU Xiaowei, ZHOU Yuhong, GAO Xinyi, SHANG Yuying, ZHANG Shujin. Application of Image Enhancement Technology Based on EnlightenGAN in Apple Detection in Natural Scenes[J]. Transactions of the Chinese Society for Agricultural Machinery,2024,55(8):266-279.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-03-24
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-08-10
  • 出版日期:
文章二维码