Rythme: Scraping module for automating and optimizing daily purchases
Summary
- Introduction
- Key metrics
- Solution and project schedule
- Results and Feedback
Introduction
Rythme, a start-up specializing in optimizing the shopping experience for everyday products, called on Terros to create a high-performance scraping solution. The aim of this project is to develop an application that will enable individuals to automate their daily shopping by bringing together products from different supermarkets (GMS) and offering the possibility of comparing prices. Terros has been asked to design a stand-alone scraping module capable of building up and regularly updating the Rythme product database.
Key metrics
+1million
products extracted from 8 supermarkets
100k
prices updated daily
Solution and project schedule
Rythme approached Terros to develop a scraping module capable of gathering and updating product data from partner supermarkets. The project presents a number of technical challenges, including the diversity of sources (different superstores) and the need to maintain a consistent data completeness while ensuring regular updates.
Terros' solution is based on two types of scraping:
Catalog Scraping: This module scans all platform catalog pages to retrieve and update product data.
Unit Scraping: This module is used to update products not retrieved by the Catalog Scraper, by processing product URLs individually.
Results and Feedback
- The deployment of the scraping module has enabled Rythme to efficiently automate the building and updating its product databaseto ensure the completeness and reliability of information. Key results include :
- Setting up a complete database : Scraping provides Rythme with an up-to-date product database, including key information (URL, EAN, price...) from several supermarkets.
- Reduce costs and lead times : Optimizing reusable components has reduced maintenance and development times, which has had a positive impact on budgets and speed of deployment.
- Real-time price comparison : End-users of the Rhythm application can now view and compare product prices with ease, offering a better shopping experience for everyday products.
- Reliable updates : The dual approach (catalog and unit scraping) ensures that product information is regularly updated, guaranteeing high data reliability for the Rythme application.
- The scraping module developed by Terros has enabled Rythme to position itself as a benchmark in the daily purchasing optimization market.
“We are very satisfied with our collaboration with Terros in the development of the scraping module for our platform. Right from the start of the project, Terros understood our vision and the specific needs of our application. Their technical expertise enabled us to overcome the challenges inherent in scraping data from several large surfaces, while guaranteeing maximum reliability.”
Rodolphe Lainé
CEO of Rythme