Skip to content

Shopping Online Crawl Data (supported Tiki, Shopee, Lazada, Amazon)

Notifications You must be signed in to change notification settings

namle133/shopping_online_scrape

Repository files navigation

shopping_online_scrape

Overview 📝

🛠️ Shopping Online Development Procedure (use Tiki, Lazada & Amazon)

Step 1: clone this repo to PC

git clone https://github.com/namle133/shopping_online_scrape.git

Step 2: run main program

cd shopping_online_scrape

make shopping_online

Step 3: fill shopping information in GUI input

For example:

Screenshot 2023-09-12 at 12 53 57

and then press the button ("Print Input Value")

Step 4: check informations which you scraped in folder shopping_online_scrape/csv/


🛠️ Shopping Online Development Procedure (use Shopee)

Step 1: clone this repo to PC

git clone https://github.com/namle133/shopping_online_scrape.git

Step 2: create .env file

Screenshot 2023-09-12 at 13 01 03

please change (username & password)

Step 3: fill shopping information in GUI input

For example:

Screenshot 2023-09-12 at 13 04 12

and then press the button ("Print Input Value")

Step 4:

You will see in the terminal:

Screenshot 2023-09-12 at 13 06 00

if you type "N":

check informations which you scraped in folder shopping_online_scrape/csv/ and done it

if you type "Y" (add item to cart):

please follow the instruction

Screenshot 2023-09-12 at 13 06 29

Note:

I use the shopping online which is located in VietNam. Therefore, if you want to crawl the data of the shopping online in foreign country, please change the url and config shopee_scraper.py , lazada_scraper.py, amazon_scraper.py and driver.py

THANK YOU !!!

About

Shopping Online Crawl Data (supported Tiki, Shopee, Lazada, Amazon)

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published