数据处理教学科研云的建设与应用

Construction and Application of Big Data Processing Teaching and Research Cloud

  • 摘要: 该文针对大数据处理平台构建成本高、部署过程复杂、资源利用率低、数据安全性差等问题,基于OpenStack构建了适用于大数据处理教学与科研实验的云计算平台,提供基于虚拟机和Swift容器的计算、存储服务以及hadoop、spark、storm等大数据处理平台的个性定制、自动部署、弹性扩展功能。该平台能有效利用现有IT硬件资源,节约实验环境运维成本,简化大数据处理系统部署与管理,降低教学科研实施门槛,为大数据处理教学、科研实验提供可靠的平台支撑。

     

    Abstract: Aiming at the problems of high cost,large deployment process,low resource utilization and poor data security of big data processing platform,this paper builds a cloud computing platform for big data processing teaching and scientific research based on OpenStack,which can provide computing,storage services based on virtual machine and Swift container,and provide other func-tions such as personalized customization,automatic deployment,and flexible extension of big data processing platforms like hadoop, spark,storm and others. The platform can effectively utilize existing IT hardware resources,save experimental environment operation and maintenance costs,simplify the deployment and management of big data processing systems,lower the threshold for teaching and research implementation,and provide reliable platform support for big data processing teaching and scientific research experiments.

     

/

返回文章
返回