摘要大数据时代已经到来，我们所处的网络世界中的数据正以前所未有的速度快速增长。数据虽多，但并没有很好的整合，所以身处网络环境中的我们并不能快速的得到要的数据。为了解决这种问题，爬虫技术快速发展。对于学生而言，早已经厌倦了题海战术，学生需要的是经过整理归纳过的题库，而不是杂乱无章的题库。本文通过python语言设计了网络习题爬取系统。本系统通过爬取习题网站来获取大量习题，对爬取得到的习题进行分类、整合，并存储到MySQL数据库中以供可视化程序调用。本系统通过Flask框架对mysql中的数据进行可视化。本系统包括两大部分：网络习题爬取和网络习题的可视化。爬取部分包括按科目对无知识点习题的爬取和按科目对有知识点习题的爬取。习题的可视化部分包括按科目进行可视化和按知识点进行可视化。本系统经过多方测试，能够稳定运行，对学生具有一定的实用价值，一定会帮助广大中学生更好的提高学习效率。68965

该论文有图24幅，表5个，参考文献10篇。

毕业论文关键词：网络习题爬取系统  爬取系统  习题爬取  习题展示   

Design and implementation of network exercise crawling system

Abstract

Big data era has come, we are in the data in the network world is rapid growth at an unprecedented speed. Data is much, but is not well integrated, so in the us in the network environment can not be quickly get to the data, in order to solve this problem the crawler technology rapid development. Already tired of the workbook for students, the students need is collated inductive question bank, rather than a random question bank. In this article, through the python language exercises crawl system is designed. Network problem through crawl crawl system problem website to get a lot of problem. Network problem sets crawl system to climb in the problem sets are classified, integrated, and stored in the MySQL database for visualization program calls. Network problem sets crawl system through the Flask framework of mysql data visualization. This program includes two parts: network problem sets crawl, network visualization exercises. Crawl program including: according to the subjects to crawl without knowledge problem, according to the subject of a knowledge problem crawl. Visualization exercises include visualization, visualization according to knowledge according to subjects. The crawlers after the test, can stable operation, believe that has a certain practical value for students, will help the students better learning, improve the learning efficiency.

Keywords:Network exercises crawling system  climbing system   exercises to climb  exercises show

目录

摘  要 I

Abstract II

1绪论 1

1.1课题背景及研究意义 1

1.1.1网络习题爬取系统研究背景 1

1.1.2网络习题爬取系统的研究意义 1

1.2开发语言及开发工具 1

1.2.1 python简介 1

1.2.2  MySQL数据库简介 2

1.2.3 开发工具及运行环境 3

1.3 本文的主要内容及组织结构 3

1.4 本章小结 4

2需求分析 5

2.1功能需求分析 5

2.1.1前台功能需求