Published quote derivation and normalization
Reproduce committed response-derived bytes and normalize the daily artifact with invariant hashes; reject an untrusted actor case before evaluation. This is not a rule benchmark.
Evaluation ledger
Measured evidence only.
This page distinguishes runnable invariants from future measurements. Targets do not become results until their cases, command, environment, and limitations are committed.
Rule outcome benchmarks use synthetic cases. The published daily quote artifact is separate normalization and refusal evidence, with provenance shown in working mode.
Row-order invariance
Shuffle the same events; expect one canonical hash.
Literal golden hash
Pin a committed fixture to its literal canonical result hash.
Exact duplicate tolerance
Insert an identical source row; expect unchanged canonical events.
Identity-conflict rejection
Reject conflicting reuse of an event or source identity.
Time-format equivalence
Normalize equivalent offset and Z timestamps to the same instant.
Sub-millisecond order
Preserve supported precision and reject timestamps beyond it.
Locale-independent order
Order canonical keys by UTF-16 code units without locale data.
Volatile-metadata exclusion
Exclude collection metadata from the canonical result hash.
Mixed-sequence policy
Fail closed on mixed sequence presence and define the all-absent order.
Dialect convergence
Replay equivalent committed source dialects to one canonical result.
Dataset-profile determinism
Keep dataset profiles stable across shuffling and source dialects.
Mapping-approval binding
Bind approval to the validated proposal and its executed transforms.
Record-set completeness
Reject omitted declared rows or approved columns before result hashing.
Mapping agreement reporting
Report per-field agreement between mapped canonical events and each mapping application's review outcome.
Reachable mapping review
Require a justified override for a flagged field while preserving a fully resolvable path.
Scenario classification
Pin three synthetic cases to their declared rule outcomes.
Evidence completeness
Resolve each finding through eventId to rawRowHash.