Modern Web Scraping with Python using Scrapy Splash Selenium
Become an expert in web scraping and web crawling using Python 3, Scrapy, Splash and Selenium 2nd EDITION (2021)
What you’ll learn
-
Understand the fundamentals of Web Scraping
-
Scrape websites using Scrapy
-
Understand Xpath & CSS Selectors
-
Build a complete Spider from A to Z
-
Store the extracted Data in MongoDb & SQLite3
-
Scrape JavaScript websites using Splash & Selenium
-
Build a CrawlSpider
-
Understand the Crawling behavior
-
Build a custom Middleware
-
Web Scraping best practices
-
Avoid getting banned while scraping websites
-
Bypass cloudflare
-
Scrape APIs
-
Scrape infinite scroll websites
-
Working with Cookies
-
Deploy spiders locally and to the cloud
-
Run spiders periodically
-
Prevent storing duplicated data
-
Build datasets
-
Login to websites using Scrapy
-
Download images and files using Scrapy
Requirements
-
Basics of Python
-
Internet access
Who this course is for:
- Anyone who wants to scrape data from any website
- Anyone who wants to learn Scrapy
- Anyone who wants to automate the task of copying contents from websites
- Anyone who wants to learn how to scrape Javascript websites using Scrapy-Splash & Selenium