Skip to content

emmanguyen0602/Stock-Price-Data-Engineering

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data Engineering Projects: Stock Prices From VNDIRECT

Introduction

In this first project, I will create make an ETL process to get information and analyze prices of stocks. The ETL pipeline will insert new batches of data once a day. I’ll create the first ETL pipeline using Airflow to populate Google Cloud Storage and BigQuery with the first large batch of VNDIRECT prices. The second ETL pipeline will be scheduled to run once a day and insert new price into BigQuery.

And the data will be connected with Google Data Studio (Looker Studio) for furthur analysis.

Platform Architecture

de_pipeline

Pipeline 1:

pipeline 1

Pipeline 2:

pipeline 2

Docker:

docker

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages