Analyzers — v0.4.0
Each scorecard is one frozen report: one analyzer, one track, one score
dimension, one model profile. Scorecards are independent result populations
and are never combined into a leaderboard. TPR/FPR are macro-averages
over templates, then semantic dimensions; incomplete outcomes are coverage,
never negatives.
bifrost-c-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-c-kernel.json
(e334de9b8752…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 1 | 1 | 46 | 0 | 0 | 100.0% | 0.0% |
c | language-extension | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-cpp-kernel.json
(12353998cacf…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 1 | 1 | 54 | 0 | 0 | 100.0% | 0.0% |
bifrost-csharp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-csharp-kernel.json
(a004277d218c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 58 | 2 | 1 | 55 | 0 | 0 | 100.0% | 0.0% |
bifrost-go-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-go-kernel.json
(a3597db4e3cc…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 58 | 7 | 7 | 44 | 0 | 0 | 100.0% | 0.0% |
bifrost-java-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-java-kernel.json
(d8ad10a3cdca…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 18 | 20 | 18 | 0 | 2 | 98.6% | 0.0% |
bifrost-javascript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-javascript-kernel.json
(9a4f3c8c5a31…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 18 | 18 | 20 | 0 | 2 | 100.0% | 0.0% |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-kotlin-kernel.json
(dad5d772414d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 15 | 13 | 28 | 0 | 2 | 97.6% | 21.4% |
bifrost-php-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-php-kernel.json
(5881b8e17f33…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 58 | 12 | 10 | 36 | 0 | 0 | 100.0% | 14.0% |
bifrost-python-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-python-kernel.json
(87f9a195df46…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 18 | 18 | 20 | 0 | 2 | 100.0% | 0.0% |
bifrost-ruby-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-ruby-kernel.json
(7af673389c11…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 0 | 0 | 58 | 0 | 0 | n/a | n/a |
bifrost-rust-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-rust-kernel.json
(2ad1e552b00c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 1 | 1 | 40 | 0 | 12 | 100.0% | 0.0% |
rust | language-extension | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-scala-kernel.json
(11c7c6462f6d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
scala | core | 58 | 5 | 5 | 48 | 0 | 0 | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-smoke.json
(bfbd71c8ea92…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
cpp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
csharp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
go | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
java | calibration | 2 | 1 | 0 | 0 | 1 | 0 | not scored | not scored |
java | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
javascript | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
kotlin | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
php | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
python | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
ruby | core | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
rust | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
scala | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
typescript | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.6 (build
18d09c57d1e5, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-typescript-kernel.json
(6d1ec2fce985…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 58 | 17 | 17 | 22 | 0 | 2 | 100.0% | 0.0% |
codeql-c-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-c-kernel.json
(0b6c59ac6e44…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 23 | 25 | 0 | 0 | 0 | 75.6% | 14.0% |
c | language-extension | 2 | 2 | 0 | 0 | 0 | 0 | 100.0% | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-cpp-kernel.json
(6e772fe67401…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 18 | 38 | 0 | 0 | 0 | 53.2% | 8.9% |
codeql-csharp-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-csharp-kernel.json
(3436137a9aa2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 58 | 24 | 34 | 0 | 0 | 0 | 69.4% | 11.8% |
codeql-go-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-go-kernel.json
(7812a935ee53…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 58 | 24 | 34 | 0 | 0 | 0 | 66.6% | 16.7% |
codeql-java-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-java-kernel.json
(bad0469701d0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 29 | 29 | 0 | 0 | 0 | 79.6% | 19.8% |
codeql-javascript-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-javascript-kernel.json
(98d8064493dd…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 23 | 35 | 0 | 0 | 0 | 77.4% | 9.0% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-kotlin-kernel.json
(bada2d8ddf78…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 25 | 33 | 0 | 0 | 0 | 68.3% | 17.1% |
codeql-python-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-python-kernel.json
(8cad62ca0ae9…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 23 | 35 | 0 | 0 | 0 | 70.5% | 10.9% |
codeql-ruby-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-ruby-kernel.json
(09358d58fb97…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 22 | 36 | 0 | 0 | 0 | 64.3% | 7.9% |
codeql-rust-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-rust-kernel.json
(30882a1c1aab…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 21 | 33 | 0 | 0 | 0 | 71.4% | 10.4% |
rust | language-extension | 2 | 0 | 2 | 0 | 0 | 0 | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled
codeql 2.26.3 (build
7d097a43199e, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-typescript-kernel.json
(ffe51480b9c3…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 58 | 23 | 35 | 0 | 0 | 0 | 77.4% | 9.0% |
joern-java-kernel-taint-taint-benchmark-controlled
joern 4.0.610 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-java-kernel.json
(7e3c4cb6adbe…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 26 | 32 | 0 | 0 | 0 | 71.8% | 18.4% |
joern-javascript-kernel-taint-taint-benchmark-controlled
joern 4.0.610 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-javascript-kernel.json
(d794fbb8d72c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 27 | 31 | 0 | 0 | 0 | 68.1% | 18.6% |
joern-php-kernel-taint-taint-benchmark-controlled
joern 4.0.610 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-php-kernel.json
(1638b81a764d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 58 | 25 | 33 | 0 | 0 | 0 | 70.2% | 16.7% |
joern-python-kernel-taint-taint-benchmark-controlled
joern 4.0.610 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-python-kernel.json
(0facb3aa7e4e…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 25 | 33 | 0 | 0 | 0 | 70.2% | 14.9% |
joern-ruby-kernel-taint-taint-benchmark-controlled
joern 4.0.610 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-ruby-kernel.json
(0d1bd231bae8…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 23 | 35 | 0 | 0 | 0 | 54.8% | 31.2% |
joern-rust-kernel-taint-taint-benchmark-controlled
joern 4.0.610 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-rust-kernel.json
(cf346a6c0bda…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 20 | 34 | 0 | 0 | 0 | 70.3% | 14.3% |
semgrep-c-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-c-kernel.json
(a75b5f370041…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 9 | 5 | 0 | 34 | 0 | 100.0% | 42.9% |
semgrep-cpp-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-cpp-kernel.json
(ef9b23c9a1fa…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 9 | 5 | 0 | 42 | 0 | 100.0% | 42.9% |
semgrep-go-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-go-kernel.json
(bab1bcdeef91…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-java-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-java-kernel.json
(60ccdc906356…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-javascript-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-javascript-kernel.json
(df957a71497c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-kotlin-kernel.json
(e1e23bfcf109…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-php-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-php-kernel.json
(22bc4cf3c0d3…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-python-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-python-kernel.json
(9eb2778656f6…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-ruby-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-ruby-kernel.json
(6f3b58ae53d1…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-rust-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-rust-kernel.json
(1739e7212692…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 9 | 5 | 0 | 40 | 0 | 100.0% | 42.9% |
semgrep-typescript-kernel-taint-taint-benchmark-controlled
semgrep 1.174.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-typescript-kernel.json
(50a0635d83a7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
Semantic dimension detail
Section titled “Semantic dimension detail”bifrost-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 8 | 0 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 16 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 1 | 0 | 0 | 1 | 12 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 22 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 1 | 0 | 0 | 1 | 14 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 18 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 1 | 0 | 0 | 0 | 21 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
local-flow | 1 | 0 | 0 | 1 | 14 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 16 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 5 | 0 | 0 | 5 | 12 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 12 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 2 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 4 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 1 | 0 | 8 | 0 | 0 | 0 | 7/8 (87.5%) | 0/8 (0.0%) | 87.5% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 4 | 0 | 2 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 6 | 0 | 2 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 10 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 2 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 18 | 0 | 2 | n/a | n/a | n/a | n/a |
interprocedural-flow | 7 | 0 | 0 | 7 | 12 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 6 | 1 | 2 | 5 | 2 | 0 | 0 | 6/7 (85.7%) | 2/7 (28.6%) | 85.7% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 8 | 0 | 2 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 5 | 0 | 1 | 4 | 6 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 2 | 0 | 1 | 1 | 2 | 0 | 0 | 2/2 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 2 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 4 | 0 | 2 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 26 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 16 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 4 | 0 | 12 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 1 | 0 | 0 | 1 | 12 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 4 | 0 | 8 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 3 | 0 | 0 | 3 | 20 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 12 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-smoke-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-smoke-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 8 | 0 | 2 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 10 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 2 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 1 | 0 | 4 | 0 | 0 | 0 | 3/4 (75.0%) | 0/4 (0.0%) | 75.0% | 0.0% |
dynamic-dispatch | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
interprocedural-flow | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
local-flow | 7 | 0 | 1 | 6 | 0 | 0 | 0 | 7/7 (100.0%) | 1/7 (14.3%) | 100.0% | 14.3% |
object-sensitivity | 3 | 2 | 1 | 4 | 0 | 0 | 0 | 3/5 (60.0%) | 1/5 (20.0%) | 60.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
heap-field-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
interprocedural-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
local-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 3 | 7 | 1 | 9 | 0 | 0 | 0 | 3/10 (30.0%) | 1/10 (10.0%) | 30.0% | 10.0% |
interprocedural-flow | 6 | 5 | 0 | 11 | 0 | 0 | 0 | 6/11 (54.5%) | 0/11 (0.0%) | 54.5% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 1 | 4 | 0 | 5 | 0 | 0 | 0 | 1/5 (20.0%) | 0/5 (0.0%) | 20.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 2 | 7 | 0 | 0 | 0 | 6/9 (66.7%) | 2/9 (22.2%) | 66.7% | 22.2% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 5 | 0 | 6 | 0 | 0 | 0 | 1/6 (16.7%) | 0/6 (0.0%) | 16.7% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 5 | 2 | 2 | 5 | 0 | 0 | 0 | 5/7 (71.4%) | 2/7 (28.6%) | 71.4% | 28.6% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 3 | 7 | 0 | 0 | 0 | 7/10 (70.0%) | 3/10 (30.0%) | 70.0% | 30.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 0 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 1 | 8 | 0 | 0 | 0 | 6/9 (66.7%) | 1/9 (11.1%) | 66.7% | 11.1% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 1 | 6 | 0 | 0 | 0 | 2/7 (28.6%) | 1/7 (14.3%) | 28.6% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 3 | 7 | 0 | 0 | 0 | 7/10 (70.0%) | 3/10 (30.0%) | 70.0% | 30.0% |
interprocedural-flow | 9 | 4 | 1 | 12 | 0 | 0 | 0 | 9/13 (69.2%) | 1/13 (7.7%) | 69.2% | 7.7% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 0 | 7 | 0 | 0 | 0 | 2/7 (28.6%) | 0/7 (0.0%) | 28.6% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 4 | 1 | 9 | 0 | 0 | 0 | 6/10 (60.0%) | 1/10 (10.0%) | 60.0% | 10.0% |
interprocedural-flow | 9 | 4 | 0 | 13 | 0 | 0 | 0 | 9/13 (69.2%) | 0/13 (0.0%) | 69.2% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 6 | 0 | 7 | 0 | 0 | 0 | 1/7 (14.3%) | 0/7 (0.0%) | 14.3% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 4 | 0 | 10 | 0 | 0 | 0 | 6/10 (60.0%) | 0/10 (0.0%) | 60.0% | 0.0% |
interprocedural-flow | 8 | 5 | 0 | 13 | 0 | 0 | 0 | 8/13 (61.5%) | 0/13 (0.0%) | 61.5% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 5 | 3 | 1 | 7 | 0 | 0 | 0 | 5/8 (62.5%) | 1/8 (12.5%) | 62.5% | 12.5% |
interprocedural-flow | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
local-flow | 7 | 0 | 1 | 6 | 0 | 0 | 0 | 7/7 (100.0%) | 1/7 (14.3%) | 100.0% | 14.3% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 1 | 8 | 0 | 0 | 0 | 6/9 (66.7%) | 1/9 (11.1%) | 66.7% | 11.1% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 2 | 5 | 0 | 0 | 0 | 3/7 (42.9%) | 2/7 (28.6%) | 42.9% | 28.6% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 1 | 9 | 0 | 0 | 0 | 7/10 (70.0%) | 1/10 (10.0%) | 70.0% | 10.0% |
interprocedural-flow | 7 | 2 | 0 | 9 | 0 | 0 | 0 | 7/9 (77.8%) | 0/9 (0.0%) | 77.8% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 4 | 5 | 0 | 0 | 0 | 6/9 (66.7%) | 4/9 (44.4%) | 66.7% | 44.4% |
interprocedural-flow | 7 | 4 | 0 | 11 | 0 | 0 | 0 | 7/11 (63.6%) | 0/11 (0.0%) | 63.6% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 3 | 1 | 5 | 0 | 0 | 0 | 3/6 (50.0%) | 1/6 (16.7%) | 50.0% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
interprocedural-flow | 8 | 5 | 1 | 12 | 0 | 0 | 0 | 8/13 (61.5%) | 1/13 (7.7%) | 61.5% | 7.7% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 1 | 9 | 0 | 0 | 0 | 7/10 (70.0%) | 1/10 (10.0%) | 70.0% | 10.0% |
interprocedural-flow | 8 | 5 | 0 | 13 | 0 | 0 | 0 | 8/13 (61.5%) | 0/13 (0.0%) | 61.5% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 3 | 2 | 3 | 0 | 0 | 0 | 2/5 (40.0%) | 2/5 (40.0%) | 40.0% | 40.0% |
dynamic-dispatch | 1 | 6 | 1 | 6 | 0 | 0 | 0 | 1/7 (14.3%) | 1/7 (14.3%) | 14.3% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 4 | 6 | 1 | 9 | 0 | 0 | 0 | 4/10 (40.0%) | 1/10 (10.0%) | 40.0% | 10.0% |
interprocedural-flow | 6 | 7 | 3 | 10 | 0 | 0 | 0 | 6/13 (46.2%) | 3/13 (23.1%) | 46.2% | 23.1% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 1 | 4 | 0 | 5 | 0 | 0 | 0 | 1/5 (20.0%) | 0/5 (0.0%) | 20.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
joern-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 5 | 3 | 0 | 8 | 0 | 0 | 0 | 5/8 (62.5%) | 0/8 (0.0%) | 62.5% | 0.0% |
interprocedural-flow | 6 | 4 | 0 | 10 | 0 | 0 | 0 | 6/10 (60.0%) | 0/10 (0.0%) | 60.0% | 0.0% |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 16 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 16 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 16 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |