This course teaches the fundamentals of web scraping using Python. By the end of the course, learners will be able to understand web page structures, parse web pages using BeautifulSoup, utilize various techniques for web scraping such as CSS and regular expressions, handle sessions and cookies, download files, accelerate web scraping using multiprocessing and asyncio, automate web scraping using Selenium, and efficiently use the Scrapy web scraping library. The course duration is 2 hours and 30 minutes, and the teaching method includes theoretical explanations, practical examples, and hands-on exercises. This course is intended for individuals interested in learning how to extract data from websites using Python for various purposes.
Overview
Syllabus
#1 Why? (爬虫 scraping 基础教学/教程 Tutorial).
#1.1 了解网页结构 (爬虫 scraping 基础教学/教程 Tutorial).
#2.1 BeautifulSoup 解析网页: 基础 (爬虫 scraping 基础教学/教程 Tutorial).
#2.2 BeautifulSoup 解析网页: CSS (爬虫 scraping 基础教学/教程 Tutorial).
#2.3 BeautifulSoup 解析网页: 正则表达 (爬虫 scraping 基础教学/教程 Tutorial).
#2.4 小练习: 爬百度百科 (爬虫 scraping 基础教学/教程 Tutorial).
#3.1 Post 登录 Cookies Session 都用 Requests (爬虫 scraping 基础 Tutorial).
#3.2 下载文件 (爬虫 scraping 基础).
#3.3 小练习: 下载国家地理美图 (爬虫 scraping 基础).
#4.1 加速爬虫: 多进程分布式 (爬虫 scraping 基础).
#4.2 加速爬虫: 异步加载 Asyncio (爬虫 scraping 基础 Python).
#5.1 让 Selenium 控制你的浏览器帮你玩爬虫 (爬虫 scraping 基础).
#5.2 高效无忧的 Scrapy 爬虫库 (爬虫 scraping 基础).
Taught by
莫烦Python
