Skip to content

Easily schedule and run dags of notebooks with : Dagster + Jupyter + a wrapper around them

Notifications You must be signed in to change notification settings

nicolasgallandpro/dagyter

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

63 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Dagyter

The goal of this projet is to easily schedule pipelines of Jupyter notebooks using Dagster (and Dagstermill).

Examples

An example with a simple dag dag

An example with a more complex dag dag

Getting started

You can call the "create_definitions" function of dagyter.py with the toml file as argument :
defs = create_definitions("/workspace/pipelines_and_scheduling.toml")

You can find a full docker example in the "example" directory.

About

Easily schedule and run dags of notebooks with : Dagster + Jupyter + a wrapper around them

Topics

Resources

Stars

Watchers

Forks