Testing a model on a Model Card failing for some models

[cfusterbarcelo]

Model Testing inside the Model Card - Report

I have been testing various models to evaluate their compatibility with the newly implemented feature that allows us to test a model inside the model card. This feature is aimed at streamlining model testing by enabling quick predictions using either provided test input images or user-uploaded images.

To provide context, I'd like to refer to the last PR with some suggestions that also need to be addressed:
Link to PR

I would also like to direct your attention to the collection of models that can be run using the bioengine-model-runner:
Link to Models

The tests on the models have been done with the example input image provided by the contributor. So, here are the lists of the tested models.

Not working Models

The models here are currently failing or have issues when tested:

1. impartial-shrimp (10.5281/zenodo.5874741)

   • Status: Failed to run

2. kind-seashell (10.5281/zenodo.5874841)

   • Status: Failed to run

3. polite-pig (10.5281/zenodo.5910163)

   • Status: Failed to run

4. naked-microbe (10.5281/zenodo.6559474)

   • Status: Image not Loading

5. nice-peacock (10.5281/zenodo.7315440)

   • Status: Failed to run
   • Note: Authors provided 3 different input test images

6. ambitious-sloth (10.5281/zenodo.7614645)

   • Status: Image not Loading

7. fiji/n2vsemdemo

   • Status: Not initializing

Working Models

On the bright side, the following models are successfully working with the new feature:

1. wild-whale (10.5281/zenodo.6079314)
2. conscientious-seashell (10.5281/zenodo.6200999)
3. thoughtful-turtle (10.5281/zenodo.6334777)
4. chatty-frog (10.5281/zenodo.6338614)
5. loyal-parrot (10.5281/zenodo.6200635)
6. loyal-squid (10.5281/zenodo.6383429)
7. fearless-crab (10.5281/zenodo.6348084)
8. powerful-chipmunk (10.5281/zenodo.5847355)
9. emotional-cricket (10.5281/zenodo.6346511)
10. willing-hedgehog (10.5281/zenodo.6028280)
11. hiding-blowfish (10.5281/zenodo.6406756)
12. organized-badger (10.5281/zenodo.6028097)
13. placid-llama (10.5281/zenodo.7261974)
14. powerful-fish (10.5281/zenodo.6384845)
15. shivering-raccoon (10.5281/zenodo.6406803)
16. non-judgmental-eagle (10.5281/zenodo.6348728)
17. straightforward-crocodile (10.5281/zenodo.5910854)
18. humorous-owl (10.5281/zenodo.5749843)
19. discreet-rooster (10.5281/zenodo.5914248)
20. independent-shrimp (10.5281/zenodo.6811491)
21. determined-chipmunk (10.5281/zenodo.6808325)
22. organized-cricket (10.5281/zenodo.7786492)
23. creative-panda (10.5281/zenodo.5817052)
24. hiding-tiger (10.5281/zenodo.5869899)
25. pioneering-rhino (10.5281/zenodo.6334383)
26. affable-shark (10.5281/zenodo.5764892)
27. passionate-t-rex (10.5281/zenodo.6334583)
28. laid-back-lobster (10.5281/zenodo.6334881)
29. joyful-deer (10.5281/zenodo.7274275)
30. easy-going-sauropod (10.5281/zenodo.7380171)
31. noisy-hedgehog (10.5281/zenodo.8064806)
32. noisy-fish (10.5281/zenodo.7772662)

We need to address the issues with the models that are failing or experiencing problems, as listed above. It's important to ensure that all models in the BioImage Model Zoo can be easily tested by users using the new feature without major roadblocks.

CC: @oeway, @Nanguage