Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Zoobot v2 release #114

Merged
merged 323 commits into from
Apr 4, 2024
Merged

Zoobot v2 release #114

merged 323 commits into from
Apr 4, 2024

Conversation

mwalmsley
Copy link
Owner

@mwalmsley mwalmsley commented Apr 4, 2024 •
edited
Loading

And it's a big one. See README.md.

Key changes:

  • New suite of pretrained models and accompanying technical report on arxiv. We cranked it up.
  • New finetuning options: n_blocks, cosine schedule, custom config for each architecture
  • Easy encoder downloading from HuggingFace via timm
  • Complete docs rewrite
  • Deprecated TensorFlow support to focus on PyTorch

@mwalmsley
revert to
6c70398 
single gpu ramdisk 6 workers b256
@mwalmsley
ramdisk
34b80e3
@mwalmsley
test on beluga
7adc169
@mwalmsley
debug sympy
1d66218
@mwalmsley
longer run, more workers/cpus
0f605ed
@mwalmsley
oops slash
6d3f528
@mwalmsley
fine, normal python
c6c1f39
@mwalmsley
try 4 gpu v100, 9 workers, ramdisk
1e9ffc9
@mwalmsley
still 4 gpu, now on SSD instead
d015e51
@mwalmsley
only 3 workers per
df15eeb
@mwalmsley
back to a100 big boy test
53ce419
@mwalmsley
2 a100
4dfbe91
@mwalmsley
debug nodesplitter
8bc5344
@mwalmsley
debug generator
ca96a86
@mwalmsley
slurm tinkering
e0bd2db
@mwalmsley
oops, 4 gpu
c02c2eb
@mwalmsley
better logging
812b857
@mwalmsley
more logging
76b0819
@mwalmsley
typo
60e0e1f
@mwalmsley
repeat=1 for debugging still, add replace_sampler_ddp flag
9a821e4
@mwalmsley
2.1 update
c83714c
@mwalmsley
typo
da24384
@mwalmsley
2 gpu scaling
45d836c
@mwalmsley
2 gpu
ea0db1f
@mwalmsley
logging
a49904c
@mwalmsley
1 gpu
0f67ab6
@mwalmsley
scaling of a100 2x repeat5x
2d8c3bb
@mwalmsley
worked great, now 4x with the split
eb19ada
@mwalmsley
add notes
9bad295
@mwalmsley
Merge branch 'narval-migration' of https://github.com/mwalmsley/zoobot …
044c69e 
…into narval-migration
mwalmsley added 29 commits March 21, 2024 15:10
@mwalmsley
bump to python 3.9
31d03ba
@mwalmsley
Merge pull request #113 from mwalmsley/narval-migration
a1ce097 
Latest finetuning changes
@mwalmsley
grab lightly cosine
8e3498f
@mwalmsley
add docstrings throughout
573ad69
@mwalmsley
num_classes=0
a588d72
@mwalmsley
tinker to set cluster vars
a7bba6d
@mwalmsley
require galaxy-datasets
0732853
@mwalmsley
tiny tweak
0bffcb5
@mwalmsley
add mae support
d2e415a
@mwalmsley
Merge branch 'dev' of github.com:mwalmsley/zoobot into dev
c8f8fa2
@mwalmsley
small note
94ad1ee
@mwalmsley
Merge branch 'dev' of github.com:mwalmsley/zoobot into dev
0f7b471
@mwalmsley
typo
b1fbe2e
@mwalmsley
change color->greyscale for consistency
2fd8775
@mwalmsley
add cosine scheduler option
5338b81
@mwalmsley
imports
7eb780a
@mwalmsley
typo
6657c55
@mwalmsley
check tasks per node
cda966f
@mwalmsley
docs pass
1fa4c08
@mwalmsley
Continue docs pass
c1744d0
@mwalmsley
docsing
e762128
@mwalmsley
readthedocs
08a66f3
@mwalmsley
m1
579bcb4
@mwalmsley
add sphinxemoji (vital)
c9f6fa6
@mwalmsley
typo
30b79ca
@mwalmsley
rebuild
2f68c7e
@mwalmsley
final docs update?
acfd970
@mwalmsley
Merge branch 'main' into dev
dce3ec7
@mwalmsley
tiny tweaks
e1b43c6
@mwalmsley mwalmsley merged commit e6279c1 into main Apr 4, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@mwalmsley