Scrapy Masterclass: Learn Web Scraping With Scrapy Framework

About this course

Web scraping is the process of scraping websites and extracting desired data from the same, and in this course, you'll learn and master web scraping using python and scrapy framework with a step-by-step and in-depth guide.A Step-By-Step GuideAssuming that you know nothing about web scraping, web crawling, scrapy framework, web scraping, or even web scrapping, we will start from the complete basics. In the first section, you'll learn about the web scraping process step-by-step (with infographics - no code), how to scrape data from websites and how to use scrapy for the same (i.e. scrapy meaning).After getting the basics clear and having an idea of how web scraping works, we will start web scraping using python & scrapy framework! Again, we'll move step-by-step and perform each step learned in the basics with bite-sized lessons. We'll take it slow so that it's easier for you to understand every step involved in scraping and extracting data from websites.Web Scraping & Scrapy EssentialsHaving built an actual web scraper, you'll get an idea of how web scraping works first-hand. Now it's crucial to cover the essential concepts of web scraping and scrapy, which we will do next.CSS Selectors to select web elementsXPath to select web elements.Scrapy Shell to test & verify selectors.Items to organise extracted dataLoad Items with ItemLoaders with input & output ProcessorsExport data to JSON, CSV, XLSX (Excel) & XML file formatsSave extracted data to online databases like MongoDB using ItemPipelines.Master Web Scraping In-DepthLearning how to scrape websites and the essentials already makes you a complete web scraper, but

Course objectives

• to provide a comprehensive understanding of web scraping
• to equip students with the skills needed to build web scrapers
• to ensure familiarity with data extraction and organization techniques