Published on

fourleafsearch - Chrome Web Store Data

Authors

In the Chrome Web Store you can find thousands of extensions, themes and apps. I'm scraping the Chrome Web Store and sharing the dataset.

In fourleafsearch you can see and download the dataset.
Here is the GitHub repo of the scraper: chrome-web-store-scraper

Project Overview
Scrape the data and share:

  1. The scraper extract and save the data from the Chrome Web Store in a PostgreSQL database
  2. After the scraping is done, the scraper makes a request to the API endpoint
  3. The backend query the PostgreSQL database and create the JSON and CSV files
  4. The frontend query the API endpoint to get the data

Tech Stack
Scrapy, PostgreSQL, AWS (API Gateway, Lambda, S3, CloudFront, etc.), Next.js, etc.