Evidence map
Generated evidence boundary. This page is generated from the checked-in selection, review, source-lock, promotion, and cohort manifests. It does not run Bifrost and it does not copy provisional scores.
The shortest honest answer is currently the published real-project-v1 result: its historical v0.2.0 page reports the measured Bifrost/reference comparison. Published result status is derived from the immutable bundles supplied to this generation run; no score is copied into this evidence map.
Evidence breadth
Section titled “Evidence breadth”| Slice | Frozen identity | Selection and review tier | Frozen denominator | Result publication |
|---|---|---|---|---|
| Prospective v1 | real-project-v1 · v0.2.0 |
prospective_pre_registered · human_adjudicated_agent_panel |
36 cases (12 per profile) | Historical release; current v1 result |
| Prospective v2 | real-project-v2 · v0.3.0 |
prospective_pre_registered · human_adjudicated_agent_panel |
36 cases (12 per profile) | Immutable release v0.3.0; generated report provenance is recorded below |
| Reviewed legacy core | legacy-promotion-v1-balanced-core · no result release yet |
retrospectively_selected · legacy_promoted |
110 cases (10 × 11 languages) | Awaiting an immutable result report |
The denominators above are not interchangeable. In particular, v1 and v2 are prospective source-only selections, while the legacy core is a separately frozen retrospective promotion of analyzer-informed development cases. A later report may present a documented stratified aggregate, but it may not flatten these trust tiers into one accuracy score.
Prospective profile denominators
Section titled “Prospective profile denominators”Each profile remains visible before any aggregate. The numbers here are selected-case counts, not analyzer outcomes.
| Slice | Language | Candidate/reference profile | Repositories | Cases |
|---|---|---|---|---|
| v1 | go | gopls |
4 | 12 |
| v1 | python | pyright |
4 | 12 |
| v1 | typescript | typescript-language-server |
4 | 12 |
| v2 | java | eclipse-jdtls |
4 | 12 |
| v2 | rust | rust-analyzer |
4 | 12 |
| v2 | cpp | apple-clangd-21 |
4 | 12 |
Reviewed legacy boundaries
Section titled “Reviewed legacy boundaries”The immutable promotion is legacy-promotion-v1-balanced-core. Its balanced core is 110 cases, with 42 overflow candidates and 6 controls kept outside the correctness denominator. The source-only legacy inventory contains 158 cases; the remaining development corpus also contains 2 semantic-pack cases that were never part of that inventory.
| Language | Balanced-core cases |
|---|---|
| cpp | 10 |
| csharp | 10 |
| go | 10 |
| java | 10 |
| javascript | 10 |
| php | 10 |
| python | 10 |
| ruby | 10 |
| rust | 10 |
| scala | 10 |
| typescript | 10 |
Immutable report provenance
Section titled “Immutable report provenance”The entries below are derived only from checksum-verified release bundles. The generated result pages remain the score authority; this index records their exact release, snapshot, manifest, and report identities without retyping score totals.
| Slice | Release | Revision | Freeze manifest SHA-256 | Report artifacts |
|---|---|---|---|---|
| v1 | v0.2.0 |
6ea6056fa6b3eb52a656a2b4a62c57956771de78 |
3258e3269c98baa980883e969df97e1c9f4920503072ca8797e2600e2b268614 |
bifrost 702a73c97d86a4c9c6b2b576c3d411306788581e4659b1ff9e82fae491c7459b, gopls 679796a7a8f3d5b5eb44cad9a9ef06a2b512f4d53fdd503414842a4024026b94, pyright c6899baca9154f464c7baefe1984d0078175813138d6c428234f3573d0665099, typescript-language-server 8dda75467e0bd2498905abb8e8e6702c185e9af5954c5513a55248ecda9a2ad4 |
| v2 | v0.3.0 |
bfebd62c2df6bae136cb3e48d3f2dd96703fc8ab |
2f930edba5e3d80e09f0bcbcde9a89b0fdb7014774b998f870ed078a9d0dc34d |
apple-clangd-21 836c92ccc6d45f4a08112810718860f079ce910807b37b1811d65ee1119a32ef, bifrost 665bcc2377a69351799e23aa08bfa8f676d65a474b68804083e50aa4f8632316, eclipse-jdtls 26b5e6487eb095b0c4ad0509de4769563f860ad13e3abf337bfbfcdbc154fe47, rust-analyzer 9b9fb5057c3065c7fa7cc0eea5402cccbebf10cb98c7cbdfb4019f6062c8cda9 |
| legacy | — | — | — | pending immutable bundle |
Remaining development evidence
Section titled “Remaining development evidence”The checked-in development corpus contains 160 cases. The reviewed legacy core accounts for 110; the 50 cases outside that core comprise 42 frozen overflow candidates, 6 unsupported/not-planned controls, and 2 semantic-pack cases. This remainder is retained for regression and diagnosis; it is not silently added to v1, v2, or the legacy denominator.
Publication safeguards
Section titled “Publication safeguards”- Prospective v1 and v2 keep separate profile/language denominators; v2 permits only documented stratified aggregation.
- The legacy manifest records
retrospectively_selected,legacy_promoted,source_only, andanalyzerOutcomeUse: forbidden; re-review cannot make the source contract preregistered. - Controls and overflow remain explicit partitions and cannot enter the balanced-core score.
- Score tables must be generated from a checksum-verified immutable report artifact bound to the matching manifest. This page records published provenance when such a bundle is supplied and otherwise reports readiness, never guessed scores.
Manifest provenance is machine-readable in docs/src/data/evidence.json and is checked in CI with scripts/generate-docs-evidence.py --check. See the current v1 result, the historical development result, and the human ground-truth audit for retained historical evidence.