Analyzers — v0.1.0
Each scorecard is one frozen report: one analyzer, one track, one score
dimension, one model profile. Scorecards are independent result populations
and are never combined into a leaderboard. TPR/FPR are macro-averages
over templates, then semantic dimensions; incomplete outcomes are coverage,
never negatives.
bifrost-smoke-taint-taint-benchmark-controlled
bifrost bifrost 0.10.2 (build
c2116609f5fc, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-smoke.json
(aaad007cd17b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
cpp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
csharp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
go | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
java | calibration | 2 | 1 | 0 | 0 | 1 | 0 | not scored | not scored |
java | core | 32 | 14 | 8 | 10 | 0 | 0 | 97.1% | 51.4% |
javascript | core | 32 | 14 | 12 | 6 | 0 | 0 | 69.4% | 36.7% |
kotlin | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
php | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
python | core | 32 | 12 | 8 | 12 | 0 | 0 | 96.7% | 50.0% |
ruby | core | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
rust | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
scala | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
typescript | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-java-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-java-kernel.json
(04324829ae3a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 32 | 15 | 17 | 0 | 0 | 0 | 73.1% | 12.4% |
Semantic dimension detail
Section titled “Semantic dimension detail”bifrost-smoke-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 3 | 0 | 0 | 0 | 0 | 3/3 (100.0%) | 3/3 (100.0%) | 100.0% | 100.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 6 | 1 | 4 | 3 | 2 | 0 | 0 | 6/7 (85.7%) | 4/7 (57.1%) | 85.7% | 57.1% |
object-sensitivity | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 3 | 0 | 0 | 0 | 0 | 3/3 (100.0%) | 3/3 (100.0%) | 100.0% | 100.0% |
bifrost-smoke-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 3 | 0 | 0 | 0 | 0 | 3/3 (100.0%) | 3/3 (100.0%) | 100.0% | 100.0% |
heap-field-sensitivity | 0 | 2 | 0 | 2 | 6 | 0 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 6 | 1 | 4 | 3 | 2 | 0 | 0 | 6/7 (85.7%) | 4/7 (57.1%) | 85.7% | 57.1% |
object-sensitivity | 0 | 1 | 0 | 1 | 2 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
path-sensitivity | 3 | 0 | 3 | 0 | 0 | 0 | 0 | 3/3 (100.0%) | 3/3 (100.0%) | 100.0% | 100.0% |
bifrost-smoke-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 2 | 0 | 2 | 0 | 2 | 0 | 0 | 2/2 (100.0%) | 2/2 (100.0%) | 100.0% | 100.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 5 | 1 | 3 | 3 | 4 | 0 | 0 | 5/6 (83.3%) | 3/6 (50.0%) | 83.3% | 50.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 2 | 0 | 2 | 0 | 2 | 0 | 0 | 2/2 (100.0%) | 2/2 (100.0%) | 100.0% | 100.0% |
bifrost-smoke-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-smoke-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 3 | 2 | 1 | 4 | 0 | 0 | 0 | 3/5 (60.0%) | 1/5 (20.0%) | 60.0% | 20.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 1 | 1 | 0 | 2 | 0 | 0 | 0 | 1/2 (50.0%) | 0/2 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |