From 4d2cfc61fffb55b01cf53573ec2a68b8ab72f6f7 Mon Sep 17 00:00:00 2001 From: Kyle Matoba <22180455+kylematoba@users.noreply.github.com> Date: Mon, 25 Sep 2023 23:24:15 +0200 Subject: [PATCH] Add pointer to the shm-size docker arg to the docs --- docs/guide/getting_started.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/guide/getting_started.md b/docs/guide/getting_started.md index 5189e58..e572186 100644 --- a/docs/guide/getting_started.md +++ b/docs/guide/getting_started.md @@ -24,6 +24,7 @@ First we need to install the dependencies. -v /path/to/Megatron-LLM/:/mpt/Megatron-LLM \ nvcr.io/nvidia/pytorch:23.07-py3 ``` + Note: "if you use Torch multiprocessing for multi-threaded data loaders, the default shared memory segment size that the container runs with may not be enough. Therefore, you should increase the shared memory size by issuing ... " (from https://catalog.ngc.nvidia.com/orgs/nvidia/containers/pytorch) `--shm-size=` as an argument to above command. E.g. `--shm-size=128gb`. 1. Enter the repository: ```