Skip to content

Alkyones/AmazonTopSellerPipeline

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Amazon Top Seller DataScrap Pipeline

Warning

IT IS NOT FOR COMMERCIAL USE AND DOES NOT INCLUDE ANY SENSITIVE INFORMATION

This script has been created to scrap top sellers with their links and prices daily with database connection and security flow.

Before using the script be sure you initialize your database following the instructions in the code and provide valid URL from amazon. Provided script uses NoSql database if you are using different database you need to change the code.

For initializing and accessing the database additional credential file is required. structure of the file explained in the code.

Before Starting:

  • 👨‍💻 Cross Platform support
  • 👨‍💻 Different databases are valid for the code
  • 👨‍💻 Cronjob friendly
  • 👨‍💻 Supports multi regions for scraping

Usage:

Using the script is easy simply running index.py file will start the process for getting help use

python3 index.py --help

For scraping you need to use --scrape [countryCode]

python3 index.py --scrape uk

And for validated country codes you should use --info-country

python3 index.py --info-country

Data Example:

dataExample

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages