Code

Adding image decoder to CoCa#467

Code

Draft

iejMac wants to merge 11 commits intomlfoundations:mainmlfoundations/open_clip:mainfrom iejMac:img_decoderiejMac/open_clip:img_decoderCopy head branch name to clipboard

+199-28

Commits

Commits on Mar 15, 2023

• Adding image decoder to CoCa

  iejMac

  committed
  055eaf7

• tokenizer in CoCa

  iejMac

  committed
  7836c44

• progress in train.py - diff preproc

  iejMac

  committed
  bb677a5

• update loss

  iejMac

  committed
  44eab43

• ok it trains

  iejMac

  committed
  b1fbef2

Commits on Mar 16, 2023

• add decode method

  iejMac

  committed
  0bb8f37

• image-generation-lsos-weight

  iejMac

  committed
  99bfb1c

• grad checkpointing + freeze

  iejMac

  committed
  44631ba

Commits on Mar 17, 2023

• save progress

  iejMac

  committed
  bd90187

• tradeoff VQGAN memory usage for samples/s + get n_embed from config

  iejMac

  committed
  b9ffe5e

Commits on Mar 19, 2023

• add method to tok

  iejMac

  committed
  1b92112