Name: Does ChatGPT Give the Same Answer Twice? ChatGPT vs Perplexity vs Google AI Overviews
Uploaded: 2026-10-27T09:00:00-07:00
Duration: 1 min 42 s
Description: We asked ChatGPT, Perplexity and Google AI Overviews the same 60 shopping questions three times in one day: how many cited sites came back, and which number stayed steady.

Published Oct 27, 2026

Does ChatGPT give the same answer twice?

Not the same sources. We asked the same 60 shopping questions three times in one day, an hour apart. Only 15% of the sites ChatGPT cited came back in all three runs, and no question got the same set of sources three times; Perplexity repeated 96% and Google’s AI Overviews 55%. The share held steady, though: in every run, 49–64% of ChatGPT’s answers cited a brand’s own website.

Chapters

0:00 Same question, three times
0:29 How many sources came back
0:48 ChatGPT: no question repeated
0:55 The share that held steady
1:11 Snapshot vs signal
1:22 What to do

Transcript

Ask ChatGPT the same shopping question three times in one day. Do you get the same sources back? We asked ChatGPT, Perplexity and Google’s AI Overviews the same 60 shopping questions, three times on one day in October, an hour apart, and recorded every site they cited.

Perplexity was the steadiest. 96% of sites it cited came back in all three rounds. Google’s AI Overviews, 55%. ChatGPT, just 15%. Not one question got the same set of sources from ChatGPT all three times.

But the big picture held still. In every run, about half of ChatGPT’s answers cited a brand’s own website, between 49 and 64%.

So one check tells you very little. A single answer is a snapshot. A share across many answers is a signal.

Ask your buyers’ questions more than once. Check the share, not one answer, and fix the pages the answers lean on. The full data is free at hasmord.com/research.

Three runs, one hour apart, on October 22, 2026, United States. Method, limits and data are in the study below.

Read the study