Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make nemo.collections.llm PreTrainingDataModule num samples configurable #11088

Merged
merged 11 commits into from
Nov 1, 2024
Merged

Make nemo.collections.llm PreTrainingDataModule num samples configurable #11088

merged 11 commits into from
Nov 1, 2024

Commits on Oct 30, 2024

  1. Make nemo.collections.llm PreTrainingDataModule num samples configurable 

    Signed-off-by: Hemil Desai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    6a73da1 View commit details
    Browse the repository at this point in the history

  2. Apply isort and black reformatting 

    Signed-off-by: hemildesai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    292dd8d View commit details
    Browse the repository at this point in the history

  3. Fix 

    Signed-off-by: Hemil Desai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    4abfa28 View commit details
    Browse the repository at this point in the history

  4. Apply isort and black reformatting 

    Signed-off-by: hemildesai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    29371f1 View commit details
    Browse the repository at this point in the history

  5. Add explicit method to build pretraining datamodule index mapping 

    Signed-off-by: Hemil Desai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    e210d88 View commit details
    Browse the repository at this point in the history

  6. Apply isort and black reformatting 

    Signed-off-by: hemildesai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    f5c8f18 View commit details
    Browse the repository at this point in the history

  7. Fix 

    Signed-off-by: Hemil Desai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    ea66c05 View commit details
    Browse the repository at this point in the history

  8. Apply isort and black reformatting 

    Signed-off-by: hemildesai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    4529117 View commit details
    Browse the repository at this point in the history

  9. fix 

    Signed-off-by: Hemil Desai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    cb791ec View commit details
    Browse the repository at this point in the history

  10. Apply isort and black reformatting 

    Signed-off-by: hemildesai <[email protected]>
    @hemildesai
    hemildesai committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    133f835 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. PR feedback 

    Signed-off-by: Hemil Desai <[email protected]>
    @hemildesai
    hemildesai committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    9494483 View commit details
    Browse the repository at this point in the history