Verify an AI signal record
An evidence sequence that does not confuse a receipt with causal model validation.
Ask for the experiment
Identify the trained component, version, data availability and evaluation policy. A model family label is not enough. Preserve which results influenced development and which tests remain untouched.
Audit the output record
Choose a consecutive period and include every output status. Check original payload and confirmed attestation for any receipt, within its actual field coverage. Do not assume omitted stops, model weights or later instructions are committed.
Classify the result
Reconstruct the declared statistical or trading measure, then inspect real account executions separately if supplied. Report missing records and exact test scope. A successful calendar check or one receipt is not a completed AI performance audit.
Sources
- QuantConnect optimization parameters
- ALFRED real-time and vintage data
- OpenTimestamps protocol documentation
Research guides
AI data leakage and holdout audit
Audit feature availability, outcome overlap and test exposure with a frozen experiment record and a worked calendar-boundary example.
Backtest, forward and live evidence
Reconcile simulated decisions, prospective instructions and account fills without promoting one evidence layer into another.
Algorithmic versus AI signal claims
Map fixed rules, trained predictions, AI explanations and order routing to the specific consumer evidence each needs.
A frozen model label is only one field
A fictional record retains weights W but lacks preprocessing identity, original input values and the target definition. A matching weights checksum cannot supply those fields. The reviewer identifies the retained artefact and asks for the missing manifest before claiming the prediction can be reproduced or its confidence interpreted.
Keep original outputs, unavailable outcomes and amendments in the eligible population. A completed attestation also has its own verified time bound, not automatic proof of earlier publication or a complete record. The new artefact and sample-unit chapters explain those distinctions while preserving the original record-verification method and source links.