文献类型：会议论文

英文题名：Research on Private Cloud Platform of Seed Tracing Based on Hadoop Parallel Computing

作者：Li Dongming[1];Li Yan[1];Yuan Chao[1];Chen Haochuan[2];Zhang Lijuan[3]

机构：[1]Jilin Agr Univ, Sch Informat Technol, Changchun, Peoples R China;[2]East China Univ Sci & Technol, Sch Law, Shanghai, Peoples R China;[3]Changchun Univ Technol, Coll Comp Sci & Engn, Changchun, Peoples R China

会议论文集：4th International Conference on Computer Science and Network Technology (ICCSNT)

会议日期：DEC 19-20, 2015

会议地点：Harbin, PEOPLES R CHINA

语种：英文

外文关键词：Private cloud; Seed tracing; Hadoop; MapReduce

摘要：It is important for the management of seeds tracing which includes the collection and calculation of seeds sale. In the paper, firstly, we designed and implemented the seeds Hadoop-based trace data processing model, through the processing of the crawl data of seed, such as ETL process, parallel computing, distributed storage. Secondly, we studied the Consistent Hash Algorithm to optimize the database cluster configuration and the great data parallel computing of MapReduce. The experiment results show that compared with the traditional single node approach, using private cloud parallel calculation can greatly improve parallel computing, the efficiency of storage and load capacity of the platform. The processing efficiency of cloud platform is increased by 33.3%.