Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add example of using MLflow or Weights & Biases #78

Open
mdiazmel opened this issue Dec 21, 2021 · 2 comments
Open

Add example of using MLflow or Weights & Biases #78

mdiazmel opened this issue Dec 21, 2021 · 2 comments

Comments

@mdiazmel
Copy link
Contributor

External tools can be used to manage ML/DL experiences (track hyperparameters, visualize metrics, store models, etc...).
Some of them are MLFlow, Weights & Biases and in a different context Hydra.

Some Jean Zay user's have been experiencing with these tools, having some examples (or maybe some kind of benchmarking) on how to use them in JZ should be helpful for other people.

@zaccharieramzi
Copy link
Contributor

I personally have been in the last few days:

  • I have setup W&B to run offline and be synced from a front node: see this script.
  • I just started using Hydra with the submitit launcher. I find it very useful and elegant, and I am definitely willing to write an example combining it all together for jean-zay-doc (probably in TF/Keras but this shouldn't be too difficult to translate to PyTorch).

@mdiazmel
Copy link
Contributor Author

Nice! PR #79 partially solves this issue. Thanks @zaccharieramzi

I'll try to add an example in the next weeks to illustrate the usage of MLFlow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants