【摘要】 随着中国海洋观测技术和数据收集手段的发展,海洋观测数据量日益庞大、数据复杂程度逐渐增多,传统的数据存储方式和处理方法无法有效地对海洋数据进行管理和分析,同时,数据的区域化和分布化成为海洋数据统一管理的一个障碍,对海洋数据挖掘造成一定困难。本文从大数据生命周期的维度,介绍了主流开源大数据框架在海洋大数据获取、存储、处理、智能分析、安全保护和治理方面的技术原理和应用。更多还原

【Abstract】 With the rapid development of China’s sea observation technologies and data collection methods, we have an ever expanding amount of observed data with more and more complexity. Therefore, the traditional data storage and processing techniques cannot effectively manage and analyze the big ocean data. Meanwhile, the regionalization and the distribution of these data become an challenge for a unified data management, during the data mining process. From the perspective of the big data life cycle, this paper reviews the technical principles of the existing open source big data framework in areas of data acquisition, storage, processing, intelligent analysis, security protection and data governance, focusing on their applications for the big ocean data.更多还原