Almost any information you want is available on the Internet. Web scraping is a key tool for data mining that information allowing for web page exploration and collection for a variety of reporting. The tools and techniques used in this course allow for data to be collected that would otherwise not be easily accessible without robotic assistance.
What you'll learn
- An introduction to the Beautiful Soup Python package
- How to scrape a web page with Beautiful Soup
- An introduction to the Scrapy Python package
- How to crawl a website with Scrapy
- Web scraping considerations