Skip to content
Snippets Groups Projects
Commit 3594e98a authored by Brent Pedersen's avatar Brent Pedersen
Browse files

prevent < 0 in n21

parent c3ab3d1e
No related branches found
No related tags found
No related merge requests found
......@@ -59,7 +59,7 @@ bool Fisher::calculate() {
long long n11 = (long)_overlapCounts;
// this could be < 0 because multiple overlaps
long long n12 = (long)max(0L, (long)_queryCounts - (long)_overlapCounts);
long long n21 = (long)(_dbCounts - _overlapCounts);
long long n21 = max(0L, (long)(_dbCounts - _overlapCounts));
long long n22_full = n22_full_bases / bMean;
long long n22 = max(0L, (long)(n22_full - n12 - n21 - n11));
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment