add experiment tracking integration to text, image classification & LLM finetuning

[rishiraj]

Worked with @soumik12345 from WandB team to successfully integrate WandB with LLM Finetuning, text & image classification. Tests are passing. Here is a notebook I used to test: https://colab.research.google.com/drive/1m0KZzcCuKRn3Rkff32XTvdIfD45hK2Va?usp=sharing

[abhishekkrthakur]

Thanks for the PR. Eventually, multiple logging should be supported. Currently, we already have tensorboard. In order to get this PR merged, we need to change how the API works. The CLI should have a --log argument which can take inputs like tensorboard and wandb. --log wandb should log to wandb and so on. if nothing is provided, no logging. please let me know if the requirements are unclear

[rishiraj]

Thanks for the PR. Eventually, multiple logging should be supported. Currently, we already have tensorboard. In order to get this PR merged, we need to change how the API works. The CLI should have a --log argument which can take inputs like tensorboard and wandb. --log wandb should log to wandb and so on. if nothing is provided, no logging. please let me know if the requirements are unclear

The requirements are clear. I am working to make the required changes.

[rishiraj]

Thanks for the PR. Eventually, multiple logging should be supported. Currently, we already have tensorboard. In order to get this PR merged, we need to change how the API works. The CLI should have a --log argument which can take inputs like tensorboard and wandb. --log wandb should log to wandb and so on. if nothing is provided, no logging. please let me know if the requirements are unclear

@abhishekkrthakur Made the changes you requested and successfully integrated all experiment trackers like "azure_ml", "clearml", "codecarbon", "comet_ml", "dagshub", "flyte", "mlflow", "neptune", "tensorboard", and "wandb" with LLM Finetuning, text & image classification via the --log argument. Tests are passing. Here is a notebook I used to test: https://colab.research.google.com/drive/1m0KZzcCuKRn3Rkff32XTvdIfD45hK2Va?usp=sharing

[abhishekkrthakur]

Please also run: make style && make quality

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.