VisibilityOS by PodPitch

Put the sample size next to the change rate

VisibilityOS saw brand presence change in 82 of 817 matched AI answer comparisons. The overall rate was 10.0%. Here’s how the counts and rates varied across the eight engine views.

What the study observed

An answer counted as present if it named the brand or linked to its official site. A pair changed when that combined label flipped.

Engine views ordered by observed change rate
Engine viewChanged / matchedRate
Grok21 / 8125.9%
Gemini web15 / 10614.2%
Claude14 / 10713.1%
Gemini9 / 1078.4%
Google AI Mode7 / 957.4%
Perplexity7 / 1076.5%
ChatGPT6 / 1075.6%
ChatGPT web3 / 1072.8%

Rates describe the questions, settings, and dates in the study. The same questions were used more than once.

Same 10% rate, different precision

Three fictional samples show how much the range narrows when you collect more independent comparisons.

Illustrative 95% Wilson intervals
1 / 101.8% to 40.4%
10 / 1005.5% to 17.4%
100 / 1,0008.3% to 12.0%

Each marker is the observed 10% rate. The bars use an independent-comparisons model for the fictional examples. Repeated questions in the study can produce correlated results.

What to report in your next audit

Report both the count and the rate for each engine and setting. Keep question text, model, search settings, language, and market aligned between rounds. When the same questions repeat across days, keep the question IDs so you can account for repeated observations in later analysis.