- Published on
fourleafsearch - Chrome Web Store Data
- Authors
- Name
- Xavier Zambrano
- @xavier7zambrano
In the Chrome Web Store, there are thousands of extensions, themes, and apps available.
I aimed to scrape the Chrome Web Store and share the dataset with the community :)
Project Overview
- Developed a scraper to extract and save data from the Chrome Web Store into a PostgreSQL database.
- Configured the scraper to make a request to an API endpoint after the scraping process is complete.
- Set up a backend to query the PostgreSQL database and generate JSON and CSV files from the scraped data.
- Implemented a frontend to query the API endpoint and display the data.
The project successfully scraped and shared the data from the Chrome Web Store. Although the fourleafsearch website is now discontinued, you can still access the scraper's GitHub repository: chrome-web-store-scraper. 
Tech Stack
Scrapy, PostgreSQL, AWS (API Gateway, Lambda, S3, CloudFront, etc.), Next.js, Vercel, etc.