Code

Optional validation loop#6

Code

Open

TJ-Solergibert wants to merge 25 commits intoswiss-ai:mainswiss-ai/nanotron-multilingual:mainfrom TJ-Solergibert:validationTJ-Solergibert/nanotron:validationCopy head branch name to clipboard

+2,094-47

Commits

Commits on Jun 26, 2024

• XGLM work in progress: Causal Attention and Positional Embeddings work

  AleHD

  committed
  7aa3940

• WIP: GPT arch almost done, hf->nt converters working perfectly for non-distributed inference

  AleHD

  committed
  78dd53c

Commits on Jul 9, 2024

• Added hf2nt frontend + tested training

  AleHD

  committed
  a74c71a

Commits on Jul 11, 2024

• Added nt2hf conversion + tests :)

  AleHD

  committed
  04eaef9

• precommit

  AleHD

  committed
  138da5f

Commits on Jul 15, 2024

• Merge pull request swiss-ai#1 from swiss-ai/gpt

  Show description for 35c43f7
  negar-foroutan

  authored
  35c43f7

Commits on Jul 16, 2024

• Added MultilingualNanoset Config

  TJ-Solergibert

  committed
  0485fd6

• Added MultilingualNanoset

  TJ-Solergibert

  committed
  539832a

• Added Language token

  TJ-Solergibert

  committed
  d9f0670

• Forgot the trainer ups

  TJ-Solergibert

  committed
  efe8720

• Fix minor errors. Everything works

  TJ-Solergibert

  committed
  25ad39b

• Updated config file with GPT2 tokenized datasets in RCP

  TJ-Solergibert

  committed
  d91f9e1

Commits on Jul 17, 2024

• Before lunch

  TJ-Solergibert

  committed
  d0c14e3

• After lunch

  TJ-Solergibert

  committed
  9cfc5ea

Commits on Jul 18, 2024

• Ready

  TJ-Solergibert

  committed
  eed7bce

Commits on Jul 22, 2024

• Just in case

  TJ-Solergibert

  committed
  27133e1

Commits on Jul 23, 2024

• just in case

  TJ-Solergibert

  committed
  5c09e11

Commits on Jul 24, 2024

• This looks good

  TJ-Solergibert

  committed
  94d6c2a

• This looks better

  TJ-Solergibert

  committed
  5cccf16

• last fixes

  TJ-Solergibert

  committed
  d75038d

• Fixed tokenizer config

  TJ-Solergibert

  committed
  ab1dd83

• deleted comments

  TJ-Solergibert

  committed
  2d91154

Commits on Aug 7, 2024

• Last fixes

  TJ-Solergibert

  committed
  ce068fd

Commits on Aug 27, 2024

• Optional validation

  TJ-Solergibert

  committed
  8e6f8ab

Commits on Sep 4, 2024

• Fix eval check

  TJ-Solergibert

  committed
  1969526