雷 章,岳德鹏,YANG Di,罗志东,许永利,于 强.基于Hadoop的区域土壤侵蚀强度计算GIS设计与实验[J].农业机械学报,2018,49(9):160-165,137.
LEI Zhang,YUE Depeng,YANG Di,LUO Zhidong,XU Yongli,YU Qiang.GIS Design and Experiment of Soil Erosion Intensity Calculating Based on Hadoop[J].Transactions of the Chinese Society for Agricultural Machinery,2018,49(9):160-165,137.
摘要点击次数: 2467
全文下载次数: 1091
基于Hadoop的区域土壤侵蚀强度计算GIS设计与实验   [下载全文]
GIS Design and Experiment of Soil Erosion Intensity Calculating Based on Hadoop   [Download Pdf][in English]
投稿时间:2018-03-29  
DOI:10.6041/j.issn.1000-1298.2018.09.019
中文关键词:  土壤侵蚀  地理信息系统  分布式存储  Hadoop  实验
基金项目:“十二五”国家科技支撑计划项目(2012BAD16B00)、国家自然科学基金项目(41371189)和高分辨率对地观测系统重大专项(08-Y30B07-9001-13/15)
作者单位
雷 章 北京林业大学 
岳德鹏 北京林业大学 
YANG Di 佛罗里达大学 
罗志东 水利部水土保持监测中心 
许永利 北京地拓科技发展有限公司 
于 强 北京林业大学 
中文摘要:在开源分布式计算框架Hadoop的基础上,选择大凌河流域为研究区,构建降雨侵蚀力、土壤可侵蚀性、坡长等土壤侵蚀因子栅格数据分布式存储策略,利用MapReduce编程模式设计实现通用水土流失方程RUSLE的算法程序进行土壤侵蚀强度计算,并扩展Geoserver的栅格文件读取功能,增大对HDFS栅格文件的读取支持,实现土壤侵蚀强度计算结果的快速发布。结果表明,该系统可实现大数据量、高分辨率土壤侵蚀因子栅格数据的区域土壤侵蚀强度快速计算,可较好满足区域土壤侵蚀预测预报的时效性要求;程序运行过程中计算任务本地化效果明显,显著降低了计算过程中的网络传输压力,网络使用率约22%,且系统性能可通过增加计算节点进一步提升。本研究可为大数据量、高分辨率栅格数据下区域土壤侵蚀强度计算及发布GIS设计开发提供指导,为大凌河流域土壤侵蚀监测提供科学依据。
LEI Zhang  YUE Depeng  YANG Di  LUO Zhidong  XU Yongli  YU Qiang
Beijing Forestry University,Beijing Forestry University,University of Florida,Water and Soil Conservation Monitoring Center, Ministry of Water Resources,Beijing Datum Science and Technology Development Co., Ltd. and Beijing Forestry University
Key Words:
Abstract:At present, the research trends and hotspots of regional soil erosion are related to efficiently accessing a large amount of soil erosion factors raster data, quickly calculating and publishing the date of soil erosion intensity. To solve these problem, a GIS was constructed, which consisted of the distributed storage of soil erosion factor raster data, the parallel computing program to calculate soil erosion intensity and the quickly publishing program of soil erosion intensity, based on the latest open source project called Hadoop. Then an experiment of calculating the DaLing River Basin’s soil erosion intensity was taken through the system. The result showed that initially the system can much effectively calculate DaLing River Basin’s soil erosion intensity from a large amount of soil erosion factors raster data. Furthermore, the system can fulfill the requirement of regional soil erosion intensity prediction and forecast. Additionally, in the process of running the program, the localization effect of the calculation task was very obvious, the network transmission pressure in the calculation process was significantly reduced, the network usage rate was maintained at about 22%, and the system performance can be further improved by adding computing nodes. Finally, the studies can provide guidance for GIS design and development of regional soil erosion intensity calculating and publishing with a large amount of high resolution raster data, and provide scientific basis for soil erosion monitoring in DaLing River Basin.

Transactions of the Chinese Society for Agriculture Machinery (CSAM), in charged of China Association for Science and Technology (CAST), sponsored by CSAM and Chinese Academy of Agricultural Mechanization Science(CAAMS), started publication in 1957. It is the earliest interdisciplinary journal in Chinese which combines agricultural and engineering. It always closely grasps the development direction of agriculture engineering disciplines and the published papers represent the highest academic level of agriculture engineering in China. Currently, nearly 8,000 papers have been already published. There are around 3,000 papers contributed to the journal each year, but only around 600 of them will be accepted. Transactions of CSAM focuses on a wide range of agricultural machinery, irrigation, electronics, robotics, agro-products engineering, biological energy, agricultural structures and environment and more. Subjects in Transactions of the CSAM have been embodied by many internationally well-known index systems, such as: EI Compendex, CA, CSA, etc.

   下载PDF阅读器