基于部分亲和场的行走奶牛骨架提取模型
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

陕西省重点产业创新链(群)-农业领域项目(2019ZDLNY02-05)、国家重点研发计划项目(2017YFD0701603)和中央高校基本科研业务费专项资金项目(2452019027)


Skeleton Extraction Model of Walking Dairy Cows Based on Partial Affinity Field
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    在奶牛关键点预测的基础上,通过点、线重构奶牛骨架结构,可为奶牛跛行检测、发情行为分析、运动量估测等提供重要参考。本研究基于部分亲和场,以养殖场监控摄像头拍摄的视频为原始数据,使用1600幅图像训练了奶牛骨架提取模型,实现了奶牛站立、行走状态下关键点信息和部分亲和场信息的预测,并通过最优匹配连接对奶牛骨架结构进行准确提取。为了验证该模型的性能,采用包含干扰因素的100幅单目标奶牛和100幅双目标奶牛图像进行了测试。结果表明,该模型对单目标行走奶牛骨架提取的置信度为78.90%,双目标行走奶牛骨架提取的置信度较单目标下降了10.96个百分点。计算了不同关键点相似性(Object keypoint similarity,OKS)下的模型准确率,当OKS为0.75时,骨架提取准确率为93.40%,召回率为94.20%,说明该模型具有较高的准确率。该方法可以提取视频中奶牛骨架,在无遮挡时具有高置信度和低漏检率,当遮挡严重时置信度有所下降。该模型的单目标和双目标图像帧处理速度分别为3.30、3.20f/s,基本相同。本研究可为多目标奶牛骨架提取提供参考。

    Abstract:

    The skeleton extraction of cows is based on the prediction of key points of cows, which can provide important reference for detection of claudication, analysis of estrus behavior, and estimation of motion of cows through point and line reconstruction of skeleton structure of cows. Based on the partial affinity field, taking the video taken by the monitoring camera of the farm as the original data, totally 1600 images were used to train the cow skeleton extraction model, and the prediction of the key point information and partial affinity field information of the cow in the standing and walking states was realized, and the accurate extraction of the cow skeleton structure through the optimal matching connection was realized. In order to verify the performance of the model, totally 100 images of single cow and 100 images of double cows were tested. The experimental results showed that the model had a 78.90% confidence in the attitude of single target walking cows, and a 10.96 percentage points decrease in the confidence of double target walking cows compared with single target walking cows. In order to test the overall accuracy of the model, the accuracy of the model under different key points similarity OKS was calculated, and the accuracy rate was 93.40% when strict standard OKS was 0.75. Furthermore, the experimental results showed that the method can extract the cow skeleton in the video, which had high confidence and low missing rate when there was no occlusion, and the confidence was decreased when there was serious occlusion. For single target and multitarget detection, the frame processing speed of the model was 3.30f/s and 3.20f/s, respectively, and the speed was basically the same, which can lay the foundation for multitarget cow skeleton extraction. The results showed that the model can extract the skeleton information of dairy cattle accurately and could be used for the research of lameness and calculation of motion behaviors.

    参考文献
    相似文献
    引证文献
引用本文

宋怀波,李振宇,吕帅朝,尚钰莹.基于部分亲和场的行走奶牛骨架提取模型[J].农业机械学报,2020,51(8):203-213. SONG Huaibo, LI Zhenyu, LV Shuaichao, SHANG Yuying. Skeleton Extraction Model of Walking Dairy Cows Based on Partial Affinity Field[J]. Transactions of the Chinese Society for Agricultural Machinery,2020,51(8):203-213.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2019-11-06
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2020-08-10
  • 出版日期: 2020-08-10