Product Scraper

Configure and start scraping operations

1 Scrape Products

2 Download HTML Pages

3 Process HTML to CSV

4 Download Images

5 Convert Images to WebP

6 Update CSV with R2 URLs

Used to match images in images_resized folder

7 Generate Report

8 Archive to Ready to Delete

Moves files to R2 ready_to_delete folder (keeps images_resized)

9 Translate CSV

10 Seed to Database

All Full Pipeline

Run all steps in order with a single URL and name:

Scrape → Download HTML → Process HTML → Download Images → Convert Images → Update CSV with R2 URLs → Generate Report → Archive Files

Automatic Step: Translation is enabled by default. Translated CSVs will be available on the Ready to Seed page for review before seeding.

⚠️ Seeding is manual only - use the "Ready to Seed" page to review and seed after translation.

Translate CSV to Persian after processing. Translated files will be available on the "Ready to Seed" page.
Seeding is disabled here. After translation, go to the Ready to Seed page to review translated CSVs and seed them manually.

📁 Ready to Use Files

Loading...

📊 Reports

Loading...