Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add scripts for traccuracy metric evaluation #99

Merged

Conversation

anwai98
Copy link
Contributor

@anwai98 anwai98 commented May 6, 2024

No description provided.

@anwai98
Copy link
Contributor Author

anwai98 commented May 6, 2024

There are a few issues I spotted - not sure the root cause of them, but I'll mention them. To begin with the status:

  • Creating tracking graphs from segmentations works!
    • For TrackMate (StarDIst), it works out-of-the-box. Does not give any troubles.
    • However, we get errors as some object tracks in the ground-truth and the micro-sam segmentations, look something like this: (Object ID: 10; Frames - 1, 2, 3, 5, 6, 7) (the _check_ctc functionality complains of the missing segmentation in the 4th frame as the example above - I run it as a sanity check as building the graphs gives me a similar, yet convoluted error)
    • Removing these objects out of the segmentation allows to create the graphs.
  • For evaluation:
    • I can get the CTC metric numbers running for TrackMate (StarDist) (w.r.t. gt) and the generalist segmentation (w.r.t. gt) (NOTE: removing out the tracks from my mention above allows me to make this work)

I have a few suspicions, I'll dig it and get back on this tomorrow (or we can have a look at it together tomorrow). Thanks!

@anwai98
Copy link
Contributor Author

anwai98 commented May 7, 2024

@constantinpape
The scripts are updated now, and the files are at /scratch/projects/nim00007/sam/for_tracking/for_traccuracy/

@constantinpape constantinpape merged commit 3a7d489 into constantinpape:tracking-metrics May 7, 2024
1 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants