7 of 12 queries changed outcome across identical repeats, same model, same day, nothing altered between runs. 60 of 60 calls succeeded, so this is the answer moving rather than the harness failing.
Find out where you actually stand
Money queries are built and disambiguated first, then run at depth against live answers rather than against a source proxy. A query counts once it has survived five identical repeats, because a single read flips: seven of our first twelve did. The treated and control split is written down before any baseline is taken.
- Money-query mapping
- Live-answer sampling
- Five identical repeats
- Pre-registered split
Twelve queries, five identical repeats, same day, nothing changed: seven flipped. All 60 calls succeeded, so this is the answer moving rather than the harness failing.
Our own measurement, step zero, 60 of 60 calls