Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Correctly report AA precision and recall during validation #253

Merged
merged 2 commits into from
Oct 24, 2023

Conversation

bittremieux
Copy link
Collaborator

Fixes #252.

AA precision and recall were swapped due to swapped input of true and predicted peptides to the evaluation.

@bittremieux bittremieux linked an issue Oct 13, 2023 that may be closed by this pull request
@codecov
Copy link

codecov bot commented Oct 13, 2023

Codecov Report

Merging #253 (1d12bc9) into dev (9a44630) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##              dev     #253   +/-   ##
=======================================
  Coverage   89.24%   89.24%           
=======================================
  Files          12       12           
  Lines         902      902           
=======================================
  Hits          805      805           
  Misses         97       97           
Files Coverage Δ
casanovo/denovo/model.py 97.45% <ø> (ø)

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

Copy link
Collaborator

@melihyilmaz melihyilmaz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

@melihyilmaz melihyilmaz merged commit 3a18fed into dev Oct 24, 2023
6 checks passed
@melihyilmaz melihyilmaz deleted the fix_validation branch October 24, 2023 05:53
melihyilmaz added a commit that referenced this pull request Nov 2, 2023
* Remove unused custom_encoder option (#254)

* resolves issue #238: remove custom_encoder option

* fixed lint issue

* fixed lint issue

* Revert "fixed lint issue"

This reverts commit bd1366c.

* lint

* lint issue

* Consistently format changelog.

---------

Co-authored-by: Isha Gokhale <[email protected]>
Co-authored-by: Wout Bittremieux <[email protected]>

* Correctly report AA precision and recall during validation (#253)

Fixes #252.

Co-authored-by: Melih Yilmaz <[email protected]>

* Remove gradient calculation during inference  (#258)

* Remove force_grad in inference

* Upgrade required PyTorch version

* Update CHANGELOG.md

* Update CHANGELOG.md

* Fix typo in torch version

* Specify correct Pytorch version change

---------

Co-authored-by: Wout Bittremieux <[email protected]>

* Add label smoothing

* Modify config file

* Minor fix config.yaml

* Run black

* Lint casanovo.py

---------

Co-authored-by: ishagokhale <[email protected]>
Co-authored-by: Isha Gokhale <[email protected]>
Co-authored-by: Wout Bittremieux <[email protected]>
Co-authored-by: Wout Bittremieux <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Bug in evaluation script during training
2 participants