黄华,朱洁,刘广昊,吴习宇,祝诗平.近红外光谱多核并行谱区选择任务调度策略研究[J].农业机械学报,2018,49(10):270-274,283.
HUANG Hua,ZHU Jie,LIU Guanghao,WU Xiyu,ZHU Shiping.Task Scheduling Strategies of Parallel Near Infrared Spectral Region Selection on Multi Core and Its Application[J].Transactions of the Chinese Society for Agricultural Machinery,2018,49(10):270-274,283.
摘要点击次数: 118
全文下载次数: 33
近红外光谱多核并行谱区选择任务调度策略研究   [下载全文]
Task Scheduling Strategies of Parallel Near Infrared Spectral Region Selection on Multi Core and Its Application   [Download Pdf][in English]
投稿时间:2018-04-28  
DOI:10.6041/j.issn.1000-1298.2018.10.030
中文关键词:  近红外光谱  谱区选择  多核并行算法  任务调度策略
基金项目:国家自然科学基金项目(31771670、31071319)、中央高校基本科研业务费专项资金项目(XDJK2017C080)和西南大学博士基金项目(SWU116044)
作者单位
黄华 西南大学 
朱洁 西南大学 
刘广昊 西南大学 
吴习宇 西南大学 
祝诗平 西南大学 
中文摘要:在近红外光谱的谱区选择算法中,滑动窗口偏最小二乘法具有较高的预测精度,但是其程序运行时间很长。在不改变算法预测精度的前提下,首先以分段间隔偏最小二乘法为基础研究了顺序分配法、等间距法和排序法等3种任务调度策略对并行算法性能的影响。在这3种任务调度策略中,排序法具有较好的负载均衡性和较高的并行效率。然后在16核云计算平台下将排序法分配策略分别应用于组合分段偏最小二乘法、反向分段偏最小二乘法和滑动窗口偏最小二乘法等谱区的并行选择算法中。经实验测试,在单核串行算法下反向分段偏最小二乘法和滑动窗口偏最小二乘法的程序运行时间分别为9.22h和55.51h,在排序法分配策略下采用2核并行算法时其程序运行时间分别缩短为4.98h和29.03h,分别节省了45.99%和47.70%的程序运行时间。实验结果表明:当考虑并行效率和计算成本时,在1~16核的并行算法中,选用2核并行执行以上4种谱区选择算法都具有最高的并行效率和性价比。
HUANG Hua  ZHU Jie  LIU Guanghao  WU Xiyu  ZHU Shiping
Southwest University,Southwest University,Southwest University,Southwest University and Southwest University
Key Words:near infrared spectroscopy  wavelength selection  multi core parallel algorithm  task scheduling strategies
Abstract:The moving window partial least squares (mwPLS) has higher prediction accuracy in the wavelength selection of near infrared spectroscopy, but the runtime of mwPLS is very long on single core serial algorithm. In order to reduce running time for wavelength selection, the task scheduling strategies on multi core were investigated. Taking interval partial least squares (iPLS) as example on the premise of not changing the prediction accuracy of the serial algorithm, the sequential distribution algorithm (SDA), equal space allocation algorithm (ESAA) and sorting allocation algorithm (SAA) were presented to study the effect of task scheduling strategy on the performance of parallel algorithm. The SAA had the best load balance and the highest parallel efficiency among the three task scheduling strategies. Then, based on the 16 cores cloud computing platform, the SAA was applied to the parallel wavelength selection algorithm of synergy interval partial least squares (siPLS), backward interval partial least squares (biPLS) and mwPLS. Comparing with single core serial algorithm, two cores parallel wavelength selection of biPLS and mwPLS with SAA reduced the runtime from 9.22h and 55.51h to 4.98h and 29.03h, and totally 45.99% and 47.70% runtime of biPLS and mwPLS were saved, respectively. The experimental results showed that when considering the parallel efficiency and computational cost condition, the two cores parallel algorithm for the four spectral region selection algorithms had the highest parallel efficiency and cost performance among the 1~16 core parallel algorithm.

Transactions of the Chinese Society for Agriculture Machinery (CSAM), in charged of China Association for Science and Technology (CAST), sponsored by CSAM and Chinese Academy of Agricultural Mechanization Science(CAAMS), started publication in 1957. It is the earliest interdisciplinary journal in Chinese which combines agricultural and engineering. It always closely grasps the development direction of agriculture engineering disciplines and the published papers represent the highest academic level of agriculture engineering in China. Currently, nearly 8,000 papers have been already published. There are around 3,000 papers contributed to the journal each year, but only around 600 of them will be accepted. Transactions of CSAM focuses on a wide range of agricultural machinery, irrigation, electronics, robotics, agro-products engineering, biological energy, agricultural structures and environment and more. Subjects in Transactions of the CSAM have been embodied by many internationally well-known index systems, such as: EI Compendex, CA, CSA, etc.

   下载PDF阅读器