To see how we print n, unit and interval, read the sample audit from our AI Hallucination Audit, another service.
Before and after. A task changed after the freeze needs your product owner's written approval and is counted apart. Before and after use unchanged tasks, measured the same way. Only labels on responses logged in a stated window are a measured rate, for that window; the rest are test results.
Cover lines. Each report's cover says who drafted the tests and who changed the system. After hardening: "Veriprajna changed the system tested, so this is not independent assurance." After a proof of concept: "Veriprajna built the system tested, so this is not independent assurance." After a review alone: "The tests were drafted by Veriprajna and run as set out in the written scope; this is not independent assurance."
Tasks we never see. After our draft is frozen, your product owner can write a small set of tasks from logs or failures never sent to us, kept out of the repository. Your engineer runs them before hardening starts and again at handover, with the scripts and judge we deliver, and we see counts only.
They print as their own client-run row, and the report says the scripts and judge were written by us. A task you share with us so we can fix it leaves the row and is counted apart. If you decline, the report says the whole test set was visible to those doing the fixes.
Lines that did not run. A line nobody ran reads "not run", and a result from recorded responses is labelled "on recordings".
Judges and repeats. The report names the judge that produced each row, and the model version of each run; a model change is reported as a change. Automated-judge agreement is reported only on a split held out from judge tuning. Repeated runs per task are stated, and an interval is printed only for independent attempts.
On a line that uses an automated judge, the written scope fixes how many tasks a person grades, and the judge only extends beyond them. If the judge falls short of the agreement level set in the written scope, that line is reported on the person-graded tasks alone, and the fee does not change.