Skip to content

Commit

Permalink
Merge pull request #72 from epfLLM/tokens_per_second
Browse files Browse the repository at this point in the history
Add pointer to the shm-size docker arg to the docs
  • Loading branch information
AleHD authored Oct 2, 2023
2 parents 4b7e20b + 4d2cfc6 commit 0e99f99
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/guide/getting_started.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@ First we need to install the dependencies.
-v /path/to/Megatron-LLM/:/mpt/Megatron-LLM \
nvcr.io/nvidia/pytorch:23.07-py3
```
Note: "if you use Torch multiprocessing for multi-threaded data loaders, the default shared memory segment size that the container runs with may not be enough. Therefore, you should increase the shared memory size by issuing ... " (from https://catalog.ngc.nvidia.com/orgs/nvidia/containers/pytorch) `--shm-size=` as an argument to above command. E.g. `--shm-size=128gb`.

1. Enter the repository:
```
Expand Down

0 comments on commit 0e99f99

Please sign in to comment.