Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Review changes for sweep experiment #4

Open
wants to merge 49 commits into
base: main
Choose a base branch
from
Open

[WIP] Review changes for sweep experiment #4

wants to merge 49 commits into from

Commits on Sep 23, 2023

  1. concept editing experiments

    @AlexTMallen
    AlexTMallen committed Sep 23, 2023
    Configuration menu
    Copy the full SHA
    2cb88f7 View commit details
    Browse the repository at this point in the history

  2. top1 and loss matrices

    @AlexTMallen
    AlexTMallen committed Sep 23, 2023
    Configuration menu
    Copy the full SHA
    6ffb97e View commit details
    Browse the repository at this point in the history

  3. fix segfault

    @AlexTMallen
    AlexTMallen committed Sep 23, 2023
    Configuration menu
    Copy the full SHA
    99ca187 View commit details
    Browse the repository at this point in the history

  4. both loss matrices

    @AlexTMallen
    AlexTMallen committed Sep 23, 2023
    Configuration menu
    Copy the full SHA
    c2d4749 View commit details
    Browse the repository at this point in the history

  5. plotting loss matrices

    @AlexTMallen
    AlexTMallen committed Sep 23, 2023
    Configuration menu
    Copy the full SHA
    e9250b9 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into editing-experiments

    @AlexTMallen
    AlexTMallen committed Sep 23, 2023
    Configuration menu
    Copy the full SHA
    bfadef8 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2023

  1. use double precision

    @AlexTMallen
    AlexTMallen committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    5407aae View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into editing-experiments

    @AlexTMallen
    AlexTMallen committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    bbdff6c View commit details
    Browse the repository at this point in the history

  3. naive quadratic erasure and editing

    @AlexTMallen
    AlexTMallen committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    c93ca68 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. create sentiment dataset

    @AlexTMallen
    AlexTMallen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    870a365 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into editing-experiments

    @AlexTMallen
    AlexTMallen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    ed96b3f View commit details
    Browse the repository at this point in the history

  3. Prepare for gutting Sweep.run

    @norabelrose
    norabelrose committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    06a9054 View commit details
    Browse the repository at this point in the history

  4. Refactor MVP

    @norabelrose
    norabelrose committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    58d3dfe View commit details
    Browse the repository at this point in the history

  5. Don't early stop too early

    @norabelrose
    norabelrose committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    ffbfb93 View commit details
    Browse the repository at this point in the history

  6. minor changes

    @AlexTMallen
    AlexTMallen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    ba1d62e View commit details
    Browse the repository at this point in the history

  7. Merge branch 'refactor' into editing-experiments

    @AlexTMallen
    AlexTMallen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    7582992 View commit details
    Browse the repository at this point in the history

  8. Better hparams

    @norabelrose
    norabelrose committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    5ca1ec0 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'refactor' into editing-experiments

    @AlexTMallen
    AlexTMallen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    18c050e View commit details
    Browse the repository at this point in the history

  10. Remove duplicate code in Sweep.run

    @norabelrose
    norabelrose committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    2d6b815 View commit details
    Browse the repository at this point in the history

  11. Backtracking in Probe.fit

    @norabelrose
    norabelrose committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    2f8cb88 View commit details
    Browse the repository at this point in the history

  12. batched eval; use CIFAR test; multiple random seeds

    @AlexTMallen
    AlexTMallen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    45b1dea View commit details
    Browse the repository at this point in the history

  13. Sweep now calls preprocessor on test set

    @norabelrose
    norabelrose committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    3e3518e View commit details
    Browse the repository at this point in the history

  14. more efficient eval

    @AlexTMallen
    AlexTMallen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    9bfb71a View commit details
    Browse the repository at this point in the history

  15. Merge remote-tracking branch 'origin/refactor' into editing-experiments

    @AlexTMallen
    AlexTMallen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    ed6acd3 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. MlpProbe now has a residual architecture

    @norabelrose
    norabelrose committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    d08f398 View commit details
    Browse the repository at this point in the history

  2. sentiment erasure, fix binary loss

    @AlexTMallen
    AlexTMallen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    4597bd3 View commit details
    Browse the repository at this point in the history

  3. label smoothing

    @norabelrose
    norabelrose committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    99488cc View commit details
    Browse the repository at this point in the history

  4. merge with refactor

    @AlexTMallen
    AlexTMallen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    0f894b2 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'editing-experiments' of github.com:EleutherAI/mdl into … 

    …editing-experiments
    @AlexTMallen
    AlexTMallen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    87fdbea View commit details
    Browse the repository at this point in the history

  6. Merge branch 'refactor' into editing-experiments

    @AlexTMallen
    AlexTMallen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    917de33 View commit details
    Browse the repository at this point in the history

  7. remove gradscaler

    @norabelrose
    norabelrose committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    71be6e7 View commit details
    Browse the repository at this point in the history

  8. improved visionprobe for editing experiment

    @AlexTMallen
    AlexTMallen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    2fc340d View commit details
    Browse the repository at this point in the history

  9. Merge branch 'refactor' into editing-experiments

    @AlexTMallen
    AlexTMallen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    a1c85ff View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2023

  1. use vanilla LEACE in sweep

    @AlexTMallen
    AlexTMallen committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    de35b2c View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. save state

    @luciaquirke
    luciaquirke committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    351e7f8 View commit details
    Browse the repository at this point in the history

  2. Save state

    @luciaquirke
    luciaquirke committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    77b7c2c View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. add gist with two more nets - vit and convnext

    @luciaquirke
    luciaquirke committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    7dbcf99 View commit details
    Browse the repository at this point in the history

  2. Add probes; add logging; add new cli for sweep

    @luciaquirke
    luciaquirke committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    acb478d View commit details
    Browse the repository at this point in the history

  3. log distance from init in model params

    @luciaquirke
    luciaquirke committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    e4c07c4 View commit details
    Browse the repository at this point in the history

  4. update gitignore

    @luciaquirke
    luciaquirke committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    bc9220a View commit details
    Browse the repository at this point in the history

  5. Add scalable resnet probe; fix trivial bugs

    @luciaquirke
    luciaquirke committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    5de0031 View commit details
    Browse the repository at this point in the history

  6. automate wandb run naming

    @luciaquirke
    luciaquirke committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    25a6fae View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. resolve stray todos

    @luciaquirke
    luciaquirke committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    21a2a8c View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. remove old cli

    @luciaquirke
    luciaquirke committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    77ec2f4 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. plot mdl

    @luciaquirke
    luciaquirke committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    7f452aa View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. restrict logging to final MDL chunk; plot cleanup; check for duplicat… 

    …e run data in sweep; increase ViT patch size to 4
    @luciaquirke
    luciaquirke committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    c78161d View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. save progress

    @luciaquirke
    luciaquirke committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    d8d68b6 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2024

  1. Add muP; add checkpointing; add MlpProbe activation variations (swigl… 

    …u, gelu); update gitignore; update sweep eraser experiment to float32; add new activation functions to plotting code
    @luciaquirke
    luciaquirke committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    8af8fbd View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2024

  1. Add mdl and loss plots with activation functions plotted together

    @luciaquirke
    luciaquirke committed Nov 23, 2024
    Configuration menu
    Copy the full SHA
    b72edcb View commit details
    Browse the repository at this point in the history