摘要随着计算机技术的迅猛发展，网络已成为人们对不同社会问题发表看法的重要场所，互联网已成为广大人民群众思想文化信息传播的集散地，网络舆情呈现了多样化的趋势。为了进行正确的舆论导向，网络舆情的监控势在必行，而爬取系统正是其中重要组成部分。本系统针对这一需求进行设计，使用B/S架构，选用Python语言和MySQL数据库进行开发。网上舆情爬取系统总共包括两大模块：前台展示模块和后台爬取模块，其中前台展示模块包括四个部分：帖子展示、帖子搜索、敏感词管理和URL设置。后台爬取模块包括两个部分：帖子爬取和帖子存储。本系统具备一定的使用价值，能够稳定运行，帮助用户了解最新舆情，为网络舆情的监控奠定基础。73676

该论文有图25幅，表2个，参考文献20篇。

毕业论文关键词：网上舆情爬取系统  舆情爬取系统  爬取系统

Design and Implementation of Crawling Public Online Opinion System

Abstract With the rapid development of computer technology, the network has become the important place where the people express the views of different social issues。 The Internet has become a distribution center for the crowds and the internet public opinion presents the trend of persification。 For the correct guidance of public opinion, public opinion monitoring network is imperative, and the crawling system is the one important component。 For the needs of development, the system uses B / S architecture, chooses Python language and MySQL database。 Online public opinion crawling system comprises a total of two modules: the foreground display module and background crawling module。 The display module consists of four parts: the display of posts, the search of posts, the management of sensitive words and the setting of URL。 Background crawling module consists of two parts: the storage of posts and the crawling of posts。 This system has some value and stable operation。 It can help users learn about the latest public opinion, and can lay the foundation for the Internet public opinion monitoring。 

This paper consists of twentyfive pictures, two tables and twenty references。

Key Words: Crawling Public Online Opinion System; Public opinion crawling system; Crawling System 

目  录

摘要Ⅰ 

AbstractⅡ

目录Ⅲ

图清单V

表清单V

1  绪论 1

1。1 课题背景及研究意义 1

1。2 开发工具的选择及语言介绍 1

1。3 本文的研究内容及贡献 2

1。4 本章小结 3

2  需求分析 4

2。1 功能需求 4

2。2 性能需求 6

2。3 可行性分析 6

2。4本章小结 8

3  系统总体功能模块设计 9

3。1 系统功能模块的划分 9

3。2 数据库设计 10

3。3 本章小结 12

4  系统实现过程 13

4。1 帖子展示子模块 13

4。2 图表展示子模块 14

4。3 敏感词管理子模块 15

4。4 帖子搜索子模块 17

4。5 URL设置子模块