Repository navigation
Call predictions positive at the shipped score (v1.0.7) - #11
Merged
Merged
Conversation
The export keeps every imputed state with a score of 0.5 or more, so the validation now calls positives the same way instead of at > 0.8. Same predictions as v1.0.6, 02 and 03 steps re-run. ADR 0002 (Proposed). Co-authored-by: Claude Code <noreply@anthropic.com>
|
Review notes, most important first:
|
| mutate( | ||
| Attribute = case_when( | ||
| grepl("TRUE$", Attribute) & Score > 0.8 ~ Attribute, | ||
| grepl("TRUE$", Attribute) & Score >= 0.5 ~ Attribute, |
There was a problem hiding this comment.
With the cutoff now >= 0.5, a taxon whose TRUE and FALSE rows both score exactly 0.5 ties in the later slice_max(..., with_ties = FALSE) at line 58. That keeps whichever row comes first in the file, so the call depends on row order. Make the tie-break explicit, for example arrange(desc(Score), desc(grepl("TRUE$", Attribute))) followed by slice_head(n = 1). Add a test for the exactly-0.5 case.
…nary calls Co-authored-by: Claude Code <noreply@anthropic.com>
Member
Author
Drafted with Claude Code. |
This was referenced Nov 9, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The 02 scripts called a predicted state positive only above a score of 0.8, while the export ships every state with a score of 0.5 or more. The MCC therefore described a stricter classifier than the one users get. This PR changes the call to 0.5 or more and re-runs the 02 and 03 steps and the summary on the v1.0.6 predictions (nothing re-predicted). Truth stays the curated state above 0.8.
Rank all: 36 of 41 discrete classes gain, median 0.03 (anaerobic 0.85 to 0.90, aerobic 0.65 to 0.68, motility 0.52 to 0.61, extreme environment 0.45 to 0.57; antimicrobial sensitivity 0.51 to 0.45). No class changes side of 0.7 at rank all; shape filamentous passes at genus. Numeric results unchanged.
docs/adr/0002 records the decision as Proposed, for Levi to accept. A follow-up copies the table into bugphyzz/inst/extdata.
Drafted with Claude Code.