Development and Application Study of Marine Data Managing and Sharing Platform

Zhang Hongxin, Duan Kanghong, Zhang Xiaobo

COMPUTER MODELLING & NEW TECHNOLOGIES 2013 17(5D) 51-57

North China Sea Marine Technical Support Center, State Oceanic Administration, China 266033

The marine scientific data has the characteristics like grid form, multiple dimensions, and geographic information included. There exists strong semantic and grammar heterogeneity among different types of marine data. So this paper studies and develops the technologies in marine data sharing platform to solve above problems. It proposes a managing and sharing scheme for marine data processing based on distributed computing technology. The scheme adopts parallel and distributed computing technology, Linux cluster technology to process the marine data in Hadoop distributed platform. The technologies of HDFS distributed file system; Map/Reduce parallel computing programming model and Hbase are also used. Then we provide the design of key modules by programming and the distributed system managing of the cloud platform, to offers a data managing and sharing platform with high reliability and stability. Finally the tests verify the feasibility and effectiveness of the proposed platform.