Skip to content

Commit

Permalink
warning DDP mode is temporarily unavailable
Browse files Browse the repository at this point in the history
  • Loading branch information
tp-nan committed Nov 7, 2023
1 parent 62f34aa commit 5b53639
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 0 deletions.
5 changes: 5 additions & 0 deletions docs/tools/training.md
Original file line number Diff line number Diff line change
Expand Up @@ -73,6 +73,11 @@ In this example, reference code for learning is provided in the torchpipe's exam
sh train_dp.sh
```
- train_ddp.py # if you use ddp in your code,you can refer to this code.

:::warning DDP mode is temporarily unavailable
DDP mode may cause the main card's memory load to be higher than other cards.
:::

```
sh train_ddp.sh
```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -72,6 +72,11 @@ type: explainer
sh train_dp.sh
```
- train_ddp.py 如果多卡并行使用了ddp,可以参考这份代码。

:::warning ddp 模式暂时不可用
ddp模式可能造成主卡显存负载过高于其他卡
:::

```
sh train_ddp.sh
```
Expand Down

0 comments on commit 5b53639

Please sign in to comment.