How AI signal claims are assessed
An evidence taxonomy, not a leaderboard produced from untested model claims.
Architecture
Identify whether the decision comes from trained ML, a fixed rule, a language-model explanation or a human. A product's ability to train models does not establish that every user strategy employs one. Keep unknown architecture unknown.
Causal validation
Ask for version identity, feature availability, training boundaries, label horizons and a declared evaluation policy. A viewed test period cannot remain an untouched holdout after it influences development. Our date checker creates a planning record, not an experimental result.
Execution evidence
Separate predictions, hypothetical strategy outcomes, prospective observation and broker fills. Costs and missed instructions can change the executable result. A receipt for a model output cannot substitute for account evidence or a complete consecutive record.
Editorial limits
These profiles are primary-document research, not model inspection or funded-account trials. No genuine user-rating dataset was supplied, so no aggregate stars or fabricated review totals are published. A service is not named the AI winner merely because its founder has credentials.
Sources
- QuantConnect optimization parameters
- ALFRED real-time and vintage data
- OpenTimestamps protocol documentation
Research guides
AI data leakage and holdout audit
Audit feature availability, outcome overlap and test exposure with a frozen experiment record and a worked calendar-boundary example.
Backtest, forward and live evidence
Reconcile simulated decisions, prospective instructions and account fills without promoting one evidence layer into another.
Algorithmic versus AI signal claims
Map fixed rules, trained predictions, AI explanations and order routing to the specific consumer evidence each needs.
An AI Trading Score Is Not Automatically a Win Probability
Inspect labels, calibration, thresholds and decision economics before turning a model score into confidence or account size.
AI Trading Claim Workbench
Separate a model score, probability claim, proposed order and observed account result. AI terminology is not a substitute for source data or reserved evaluation.
The requested claim controls the evidence packet
Name whether the claim concerns a function, trained model, probability, prospective output or actual customer account. Preserve the corresponding input contract, original population, dates and producing version. Do not collapse unlike products into an invented common ranking. A genuine source can support one proposition while leaving the next unverified.
Freeze raw causal entry identity before applying the selected exit's later economics. Preserve original research fills and window rules separately from actual execution. Successful website tests establish the publication's own software, not an independent strategy sample. The new illustration uses existing statistical libraries for explicit synthetic metric arithmetic; it does not launch a model tournament, certify an instrument or promote production trading.
Purpose and material-relationship limits
The owner describes these publications as legally independently owned and asks that their useful research support awareness of Vector Ridge and Darren O'Neill. That promotional purpose is disclosed here. It does not establish independent editorial direction, no sponsorship or no referral relationship. Those arrangements need an accountable register, and no preferred product receives an unsupported AI-validation verdict.