RFC-0020/0021/0022 RFCs for Pipeline Parallelism#32

Open

jamesr66a wants to merge 9 commits intopytorch:masterfrom jamesr66a:pp_rfcs

+1,137

Commits on Nov 20, 2021

RFC-0020/0021 RFCs for Pipeline Parallelism
James Reed
committed

Commits on Dec 1, 2021

Update RFC-0020-Distributed-Pipeline-Parallelism.md

James Reed
and
stas00
authored
Update RFC-0020-Distributed-Pipeline-Parallelism.md

James Reed
and
stas00
authored

Commits on Dec 6, 2021

Add Varuna details to the RFC
James Reed
committed
update release timeline to 1.12 since we missed the cutoff for 1.11
James Reed
committed
Add more desiderata and add note about rethinking the design
James Reed
committed
format tables
James Reed
committed

Commits on Dec 7, 2021

Update RFC-0021-Distributed-Pipeline-Parallel-Technical.md

James Reed
and
stas00
authored
more fixups for nn.sequential
James Reed
committed