Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CoCa: fix MultimodalTransformer init + Mask CLS token at end of seq #551

Open
wants to merge 21 commits into
base: main
Choose a base branch
from
Open

CoCa: fix MultimodalTransformer init + Mask CLS token at end of seq #551

wants to merge 21 commits into from

Commits on Jun 24, 2023

  1. make as with cls at the end

    @gpucce
    gpucce committed Jun 24, 2023
    Configuration menu
    Copy the full SHA
    852b2f4 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. transformer.py: MultimodalTransformer not using init_parameters

    iejmac committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    88f70ba View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. Merge branch 'fix_multimodal_transformer' of https://github.com/iejMa… 

    …c/open_clip into fix_multimodal_transformer
    @gpucce
    gpucce committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    ad716d7 View commit details
    Browse the repository at this point in the history

  2. test CI

    @gpucce
    gpucce committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    dcb18d7 View commit details
    Browse the repository at this point in the history

  3. move back ci

    @gpucce
    gpucce committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    491bb5c View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. split pooling

    @gpucce
    gpucce committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    dce72e8 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/double_att_pool' into fix_multim… 

    …odal_transformer
    @gpucce
    gpucce committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    623226c View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2023

  1. Revert "split pooling" 

    This reverts commit dce72e8.
    @gpucce
    gpucce committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    10adb3e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into fix_multimodal_transformer

    @gpucce
    gpucce committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    0e5fded View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. Merge branch 'main' into fix_multimodal_transformer

    @iejMac
    iejMac authored Jul 19, 2023
    Configuration menu
    Copy the full SHA
    14f0121 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. minor fix to allow 0shot in training

    @gpucce
    gpucce committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    0dfb922 View commit details
    Browse the repository at this point in the history

  2. white spaces

    @gpucce
    gpucce committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    5e6716b View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. use default param init

    @gpucce
    gpucce committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    48bf1d2 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. default lm head init

    @gpucce
    gpucce committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    589983a View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. init lm head to zeros

    @gpucce
    gpucce committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    7f88211 View commit details
    Browse the repository at this point in the history

  2. add coca to regression tests

    @gpucce
    gpucce committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    b703d12 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/main' into fix_multimodal_tran… 

    …sformer
    @gpucce
    gpucce committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    2937e86 View commit details
    Browse the repository at this point in the history

  4. add transformer compat

    @gpucce
    gpucce committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    f958139 View commit details
    Browse the repository at this point in the history

  5. reasonable compat

    @gpucce
    gpucce committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    00d2206 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2023

  1. Merge branch 'main' into fix_multimodal_transformer

    @gpucce
    gpucce committed Sep 9, 2023
    Configuration menu
    Copy the full SHA
    47f04aa View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2023

  1. remove transformers bound

    @gpucce
    gpucce committed Sep 10, 2023
    Configuration menu
    Copy the full SHA
    b4fcd70 View commit details
    Browse the repository at this point in the history