孟超英,张雪彬,陈红茜,李 辉.基于Hadoop的蛋鸡设施养殖智能监测管理系统研究[J].农业机械学报,2018,49(9):166-175.
MENG Chaoying,ZHANG Xuebin,CHEN Hongqian,LI Hui.Design of Intelligent Monitoring and Management System Based on Hadoop for Large scale Layer House[J].Transactions of the Chinese Society for Agricultural Machinery,2018,49(9):166-175.
摘要点击次数: 212
全文下载次数: 111
基于Hadoop的蛋鸡设施养殖智能监测管理系统研究   [下载全文]
Design of Intelligent Monitoring and Management System Based on Hadoop for Large scale Layer House   [Download Pdf][in English]
投稿时间:2018-03-25  
DOI:10.6041/j.issn.1000-1298.2018.09.020
中文关键词:  蛋鸡  数据查询  智能监测  Hadoop  HBase
基金项目:国家重点研发计划项目(2017YFD0701602、2016YFD0700204)
作者单位
孟超英 中国农业大学 
张雪彬 中国农业大学 
陈红茜 中国农业大学 
李 辉 中国农业大学 
中文摘要:为实现对蛋鸡生产过程中长期积累的海量数据进行高效存储和实时查询,利用Hadoop生态系统,设计了规模化蛋鸡设施养殖智能监测管理系统。针对环境数据的实时监测及大规模数据查询,用MySQL数据库存储近期数据、HBase存储历史数据,有效提升了检索速度;针对海量异构视频数据的统一管理,设计实现了基于MapReduce并行处理框架的分布式转码模块,将1.5GB的视频分割为多个128MB分段后进行转码,转码效率提高了50%。该系统实现了规模化蛋鸡场生产养殖中对实时信息、历史信息、基础设施信息、生产过程信息的统一管理,并提供了统计分析模块对采集获取的数据进行整合分析,开发了Web端网页版本及移动端APP版本的智能监测管理系统,便于用户进行实时访问,提高了生产养殖的工作效率。
MENG Chaoying  ZHANG Xuebin  CHEN Hongqian  LI Hui
China Agricultural University,China Agricultural University,China Agricultural University and China Agricultural University
Key Words:laying hens  data query  intelligent monitoring  Hadoop  HBase
Abstract:With the appearance and continuous development of the Internet of things, the monitoring data grows explosively. Accordingly, traditional data storage and processing can not meet the requirements.In order to store data effectively and query data in real time, intelligent monitoring and management system based on Hadoop for large scale layer house was developed. The HDFS file system and HBase database in the Hadoop ecosystem can store massive data distributed. The environmental monitoring data had the characteristics of once writing and multiple queries. In order to realize the real time monitoring and large scale data query for environmental data, MySQL database was used to store recent data and HBase database was used to store historical data. Experiments indicated that the query speed was improved effectively. For the unified management of massive heterogeneous video data, the distributed transcoding of video was designed and implemented. Experimental results showed that the proposed scheme can increase about 50% of the transcoding efficiency when the video size was 1.5GB and the segment size was 128MB. The system realized real time information display, historical information query, infrastructure management, production process management and statistical data analysis, environmental alerts and system management in production and breeding of large scale layer house, which can be accessed through web pages and mobile APP by users in real time. The actual application showed that the system helped managers to control the production process on all aspects and improve the efficiency of the production personnel.

Transactions of the Chinese Society for Agriculture Machinery (CSAM), in charged of China Association for Science and Technology (CAST), sponsored by CSAM and Chinese Academy of Agricultural Mechanization Science(CAAMS), started publication in 1957. It is the earliest interdisciplinary journal in Chinese which combines agricultural and engineering. It always closely grasps the development direction of agriculture engineering disciplines and the published papers represent the highest academic level of agriculture engineering in China. Currently, nearly 8,000 papers have been already published. There are around 3,000 papers contributed to the journal each year, but only around 600 of them will be accepted. Transactions of CSAM focuses on a wide range of agricultural machinery, irrigation, electronics, robotics, agro-products engineering, biological energy, agricultural structures and environment and more. Subjects in Transactions of the CSAM have been embodied by many internationally well-known index systems, such as: EI Compendex, CA, CSA, etc.

   下载PDF阅读器