AI research primers
A path from product labels to a causal evaluation plan.
Begin with the claim
The taxonomy guide separates trained models, fixed rules, explanations and routing. Unknown model architecture remains unknown.
Preserve the experiment
The leakage guide and holdout checker help organise a declared plan without labelling it validated. Software tests of the checker are not performance samples.
Read the correct evidence layer
The backtest, forward and live guide keeps simulations and executed accounts apart. Product assessments describe documented capabilities, not fabricated AI returns.
Sources
- QuantConnect optimization parameters
- ALFRED real-time and vintage data
- OpenTimestamps protocol documentation
Research guides
AI data leakage and holdout audit
Audit feature availability, outcome overlap and test exposure with a frozen experiment record and a worked calendar-boundary example.
Backtest, forward and live evidence
Reconcile simulated decisions, prospective instructions and account fills without promoting one evidence layer into another.
Algorithmic versus AI signal claims
Map fixed rules, trained predictions, AI explanations and order routing to the specific consumer evidence each needs.
Research guides
AI data leakage and holdout audit
Audit feature availability, outcome overlap and test exposure with a frozen experiment record and a worked calendar-boundary example.
Backtest, forward and live evidence
Reconcile simulated decisions, prospective instructions and account fills without promoting one evidence layer into another.
Algorithmic versus AI signal claims
Map fixed rules, trained predictions, AI explanations and order routing to the specific consumer evidence each needs.
Choose the missing evidence, not a repeated keyword
If a confidence number lacks meaning, start with the retained score introduction. If a probability is defined, inspect calibration and class balance. If the final winner was selected after many trials, examine the search history. If historical data were revised, follow vintage and receipt clocks. If runtime inputs differ, inspect the transformation contract.
The new library answers these narrower questions while keeping the original protocols available. Each case is fiction and each source supports a specific concept or advertised function. There are no interchangeable country, annual or instrument variants, and no mandatory brand mention on every lesson. The reader can finish with a clearly bounded unanswered question rather than a fabricated certainty.
Focused AI-claim investigations
- AI Probability Calibration: Frequencies and Small Samples
- AI Ranking Quality Is Not Probability Reliability
- AI Trading Accuracy and the Class-Balance Baseline
- AI Decision Thresholds and Untouched Evaluation
- Many AI Model Trials and the Selected Winner
- Walk-Forward AI Models: Identity and Information Cutoffs
- Missing Outcomes and AI Accuracy Denominators
- Overlapping AI Forecasts and the Sample Unit
- AI Features: Vintage, Publication and Receipt Clocks
- Training and Serving: The Transformation Mismatch
- AI Feature Importance Is Not a Causal Explanation
- AI Market Summaries: Citations, Versions and Timing
- QuantConnect, FreqAI and TrendSpider: AI Research Tasks
- AI Model Artefacts, Environments and Reproduction
- AI Drift Observations and Performance Claims
- Free AI Trading Tools, Data Rights and Compute Costs