Oct 20, 2021
[Tech Blog] Scrapy with Django Integration
This blog is about Integrating Django with scrapy. The goal is to retrieve any public data availble on the world wide web or the internet using Scrapy and then build a service on top of it using Django.
Let's just dive right into it with an overview of web-scraping and scrapy.
What is scraping
Scraping is the process of data mining. Also known as web data extraction, web harvesting, spying. It is software that simulates human interaction with a web page to retrieve any wanted information (eg images, text, videos). This is done by a scraper.