Efficient big data processing strategy based on Hadoop for electronic commerce logistics

Jiaojin Ci

COMPUTER MODELLING & NEW TECHNOLOGIES 2013 17(5C) 140-144

Institute of Economy and Management, Nanyang Normal University，Nanyang, 473061, China

With the rapid development of cloud computing, more and more electronic commerce applications are confronted with the problems of processing big data, such as big data from the social media posted by the customers of electronic commerce logistics. In order to improve the big data processing efficiency in electronic commerce logistics, an efficient big data processing strategy based on Hadoop is designed, which is named ECLHadoop. In ECLHadoop, those closely related data blocks are placed at the same nodes, which can help to reduce the MapReduce I / O cost, especially the I / O cost at the shuffling stage. The simulation experiment results show that, based on Hadoop, the ECLHadoop can improve the big data computing efficiency for data-intensive analysis in the electronic commerce logistics service.