›› 2015, Vol. 28 ›› Issue (12): 167-.

• Articles • Previous Articles    

Research on Processing and Storage Mode of Big Bata

SUN Hong,HAO Zeming   

  1. (1.School of Optical-Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai 200093,China;
    2.Shanghai Key Lab of Modern Optical System,Shanghai 200093,China)
  • Online:2015-12-15 Published:2015-12-15

Abstract:

Based on the characteristics of big data,the paper proposes quickly recognizing top search queries by the tag cloud.It also introduces the advantages of the traditional data warehouse in query and storage structure,and puts forward a different method of data transfer from the traditional ones in the collaboration mode,which is based on the combination of data warehouse and Hadoop platform.The data middle ware is used,and a comparison between the time taken for the same quantity of records to be introduced into Hadoop shows that the method proposed is superior to Sqoop.

Key words: big data;data storage;data analysis;Hadoop;the tag cloud

CLC Number: 

  • TP311