diff --git a/RFC-0021-Distributed-Pipeline-Parallel-Technical.md b/RFC-0021-Distributed-Pipeline-Parallel-Technical.md index c987d540..a846e00f 100644 --- a/RFC-0021-Distributed-Pipeline-Parallel-Technical.md +++ b/RFC-0021-Distributed-Pipeline-Parallel-Technical.md @@ -629,14 +629,14 @@ We can start analyzing the approaches by these design axes * Approach 5: RPC with remote modules and generalized Module-server architecture (SageMaker) * Approach 6: SPMD with Program capture/JIT compilation and message passing (OneFlow) -| |DA1 |DA2 |DA3 |DA4 |DA5 |DA6 |DA7 |DA8 |DA9 |Notes | -|--- |--- |--- |--- |--- |--- |--- |--- |--- |--- |--- | -|Approach 1 |multi |py |FF |local |manual |local |async |? |X | | -|Approach 2 |single |py |seq |dist |dist |dist |sync |X |X | | -|Approach 3 |single |py |seq |dist |dist |dist |sync |X |X | | -|Approach 4 |multi |interp |seq |local? |manual |local |async* |X |? | | -|Approach 5 |single* |py |FF |local? |manual |local? |sync? |X |X |Schedules? | -|Approach 6 |multi |interp |FF |local? |manual? (graph?) |local? |async? |X |X | | +| |DA1 |DA2 |DA3|DA4 |DA5 |DA6 |DA7 |DA8|DA9|Notes | +|--- |--- |--- |---|--- |--- |--- |--- |---|---|--- | +|Approach 1|multi |py |FF |local |manual |local |async |? |X | | +|Approach 2|single |py |seq|dist |dist |dist |sync |X |X | | +|Approach 3|single |py |seq|dist |dist |dist |sync |X |X | | +|Approach 4|multi |interp|seq|local?|manual |local |async*|X |? | | +|Approach 5|single*|py |FF |local?|manual |local?|sync? |X |X |Schedules?| +|Approach 6|multi |interp|FF |local?|manual? (graph?)|local?|async?|X |X | | ### Decision - Approach 3 with Modifications @@ -653,9 +653,9 @@ After deliberation, we want to build the API with the least complexity, at least Approach 3 with modifications then looks like: -| |DA1 |DA2 |DA3 |DA4 |DA5 |DA6 |DA7 |DA8 |DA9 |Notes | -|--- |--- |--- |--- |--- |--- |--- |--- |--- |--- |--- | -|Approach 3 with Modifications |single |py |seq |local |manual |dist |sync |X |? | | +| |DA1 |DA2|DA3|DA4 |DA5 |DA6 |DA7 |DA8|DA9|Notes| +|--- |--- |---|---|--- |--- |--- |--- |---|---|--- | +|Approach 3 with Modifications|single|py |seq|local|manual|dist|sync|X |? | | **Future Extensibility**