- Published on
fourleafsearch - Chrome Web Store Data
- Authors
- Name
- Xavier Zambrano
- @xavier7zambrano
In the Chrome Web Store you can find thousands of extensions, themes and apps. I'm scraping the Chrome Web Store and sharing the dataset.
In fourleafsearch you can see and download the dataset.
Here is the GitHub repo of the scraper: chrome-web-store-scraper
Project Overview
Scrape the data and share:
- The scraper extract and save the data from the Chrome Web Store in a PostgreSQL database
- After the scraping is done, the scraper makes a request to the API endpoint
- The backend query the PostgreSQL database and create the JSON and CSV files
- The frontend query the API endpoint to get the data
Tech Stack
Scrapy, PostgreSQL, AWS (API Gateway, Lambda, S3, CloudFront, etc.), Next.js, etc.