In today's world, internet has an overwhelming amount of data, this same data is used by different stakeholders for different services. Saving this data set manually would be an enormous amount of work. Web Scraping is a process of extracting data from websites automatically. Scrapy is a Python framework designed for large scale web scraping. Scrapy's architecture is build around "Spiders", which are self-contained crawlers. Spiders are Python classes which are used by the framework to extract from the website(s). As an example, in this post we will scrape the popular Canadian website Redflagdeals - Hot Deals section to extract the information like Deal Title, Vote Count and the Link to the deal. This information would be dumped in a .csv file which can be used to sort the deals based on the vote count. To start with, we will install the Scrapy and create a new project pip install scrapy scrapy startproject rfd Our new project will have the f