Use your own pre-trained model for downstream segmentation

[yyy1998-i]

I would like to ask you a question, I pre-train on my medical image data set (6k) according to the official pre-training code, and then the downstream task is segmentation, but the fine-tuning results with my own pre-training model is always inferior to the author's pre-training model with imagenet, which is why, is my pre-training data is still too small?

[Jivitesh2001]

Hey,
Your dataset seems too small compared to Imagenet-1K. A suggestion - you should initialize your model using the pre-trained model weights of Imagenet and then continue pre-training on your medical image dataset, which you can use for your downstream task. Please let me know how this goes for you.

[yyy1998-i]

Hey, Your dataset seems too small compared to Imagenet-1K. A suggestion - you should initialize your model using the pre-trained model weights of Imagenet and then continue pre-training on your medical image dataset, which you can use for your downstream task. Please let me know how this goes for you.

Ok, thank you very much for your reply. Next, I will try according to what you said. Thanks again

[Jivitesh2001]

Hello,
Have you tried this approach? and Can you tell me what were your results?