What is a confidence interval in AI visibility measurement?
A confidence interval gives the range in which the true value of a measured ratio lies with a stated level of certainty. In AI visibility it shows how far a citation rate may be off because of fluctuating answers and a limited sample.
If you evaluate twenty answers and find your brand in five, your measured ratio is one quarter. The true share you would see across endless queries can still be clearly higher or lower. The interval makes this uncertainty visible, and it narrows as more queries go into the measurement.
The required samples are larger than many reports suggest. A study on uncertainty in AI visibility estimates that an interval of plus or minus 5 percentage points needs roughly 40 to 50 questions on Gemini, about 100 on Perplexity and more than 150 on SearchGPT, because answers vary to different degrees on each engine.
Commercial tools rarely report such intervals so far. A value without an interval leaves open whether a month over month change is real or just noise.
What it means for your website
Before reading a change in a ratio as a win or a loss, ask for the sample size. If the intervals of two measurements overlap heavily, no difference is established. For your own analysis: fewer questions with more repetitions and stated uncertainty beat many questions with one run each and a number that only looks exact.
Sources
Terms help you understand. Whether AI crawlers can reach your site is something you measure.
Check your website for freefree · no signup · no credit card