摘要随着互联网时代的发展，信息量变得越来越庞大，对于企业而言，要进行任务计算和 数据处理所消耗的资源也越来越多，单机的执行工作任务变得愈发困难，这时需要一个完 善、可靠、高效的管理系统集中统一的分配调度任务和工作在分布式集群中执行，本课题 基于 Zookeeper 框架作为消息协调的中间件，并考虑通信连接、负载均衡、容灾处理、状 态监测、在线扩展、数据备份、心跳检测等方面，详细地研究设计一个合理且稳定的框架 结构，以及系统会遇到的各个问题及解决方案，并通过编程实现一个简单可行的分布式调 度系统，同时通过良好的图形化 Web 系统进行定时任务的管理和控制，用户通过简单操作 即可自动、高效且安全地完成工作任务的分布式调度执行。78602

毕业论文关键词 分布式 调度系统 定时任务 消息协调 负载均衡

毕 业 设 计 说 明 书 外 文 摘 要

Title   The design and accomplishment of a distributed scheduling system based on big data platform

Abstract With the development of Internet, the amount of information and data have been becoming larger。 For the enterprises，consumption of task-computing and data processing also need more and more resources, the performing of task in single computer becomes more difficult, so we need a perfect, reliable and efficient management system to assign and control tasks executing in the distributed cluster uniformly。 This project is based on the Zookeeper framework as the message coordination middleware, and considers the communication connection, load balancing, disaster treatment, condition monitoring, online expansion, data backup, heartbeat detection and other aspects, detailedly research and design a reasonable and stable structure, and the various problems which system will encounter and their solutions, then realize a simple and feasible distributed scheduling system by programming, at the same time through the graphical Web system achieving management and control of timed tasks, users can make simple operation to automatically, efficiently and safely completing the distributed scheduling execution of tasks。

Keywords  distributed  scheduler  cron-job  coordinator load-balancing

本科毕业设计说明书 第 I 页

目 次

1 引言 1

1。1 研究背景及意义 1

1。2 研究现状及前景 1

1。3 论文研究内容 2

2 概念介绍与技术分析 3

2。1 相关概念 3

2。2 核心技术 4

3 系统需求分析 6

3。1 系统整体需求介绍 6

3。2 模块功能划分 7

4 系统概要设计 9

4。1 Zookeeper大数据平台分布式调度系统的设计与实现:http://www.youerw.com/jisuanji/lunwen_90622.html