Blog/How-To
HOW-TO

How to Test Your Business Across Five AI Assistants in One Afternoon

A rotary card carousel of dark smoked glass in a deep blue void, a ring of identical blank cards on a spindle, the card at the top glowing warm amber from within

Key Takeaways

  • Fix the wording before you ask anything. Ten questions, written down, used verbatim on every engine. The moment you improvise a phrasing, the run stops being comparable to the next one.
  • Use a fresh session with no memory of you. An assistant that has spent a month helping you with your own marketing is not a neutral witness. Log out, or use a private window.
  • Record the rivals, not just yourself. The names that appear instead of yours are the actual finding. Your own absence is one bit of information; their presence tells you what got them there.
  • Expect the five to disagree. Disagreement is the normal result, not an error in your method. Different engines gather evidence differently, so being named by one says little about the others.
  • Date it and repeat it. A single afternoon is a photograph. Two afternoons a month apart, with identical wording, is the first thing that can honestly be called a measurement.

You can find out where you stand with every assistant your buyers use in a single afternoon, for nothing, using a notebook and a browser. Most people who try this get an unusable result, and always for the same four reasons.

The work itself is not hard. The discipline is: the same ten questions, the same wording, a session that has never met you, and a record of who was named instead of you.

This is the whole procedure, timed, with the mistakes marked. By the end of it you will have a dated sheet you can compare against next month, which is considerably more than most businesses in your market have.

How do you test your business across five AI assistants?

Write ten buyer questions in fixed wording. Open a logged-out session on ChatGPT, Perplexity, Google AI Overviews, Gemini, and Claude. Ask all ten on each one, unchanged. Record every business name that comes back, including the ones that are not yours.

That is fifty answers. It takes about two and a half hours the first time and closer to ninety minutes once your question list exists, because writing the questions is most of the work you only do once.

The output is not a score. It is a sheet with a date on it, showing which questions name you, which engines never do, and which competitor turns up most often. Everything useful comes from comparing that sheet to the next one.

What to settle before you start

Three decisions, and all three are easy to get wrong in a way that quietly ruins the afternoon.

First, the questions. Ten, phrased the way a buyer would type them, with your business name absent from every one. "Who can help me get back into running after a knee injury" is a buyer question. "Best running coaches" is a survey question, and "is [your name] any good" is a vanity question. The twenty prompts worth trying is a reasonable place to draw from.

Second, the session. Logged out, or a private window. OpenAI's own explanation of what ChatGPT is describes a system that works from a conversation, and a conversation it has had with you for six months is not the conversation your buyer is having.

Third, the sheet. Ten rows for the questions, five columns for the engines, one date at the top. Each cell gets one of three marks and a note of who else was named. Nothing more elaborate than that survives contact with the second run.

The afternoon, block by block

Five blocks, about two and a half hours. The bars below are planned time rather than measured time, and the run itself is the block that stretches if an engine is slow.

ONE AFTERNOON, FIVE BLOCKSPLANNED TIME, NOT MEASURED
Write the ten questions 20 min In your buyers wording, saved once
Set up the sheet 10 min Ten rows, five columns, one date
Run all five engines 75 min Fifteen minutes each, wording unchanged
Mark every answer 20 min Named, not named, or named a rival
Read the pattern 25 min Which questions and which engines
answerhalo.com
Bar length is time. The run block is longer than the other four put together, which is the honest shape of the afternoon. Every block and its duration is written out below.

In text, because nothing may live only inside a figure. Write the ten questions, 20 minutes, in your buyer's wording and saved once. Set up the sheet, 10 minutes, ten rows by five columns with one date. Run all five engines, 75 minutes, roughly fifteen minutes each with the wording unchanged. Mark every answer, 20 minutes, as named, not named, or named a rival. Read the pattern, 25 minutes, looking at which questions and which engines. That is 150 minutes, and the durations are a plan rather than a measurement.

The five engines, one at a time

They behave differently enough that treating them as one thing is the second most common way to waste the afternoon. What to expect from each, and what is worth writing down.

The five assistants, how each one behaves in a test run, and what to record
Engine How to reach it What is different about it What to record
ChatGPT Logged-out session in a private window Answers many questions from what it already learned, so it moves slowly Names given, and whether it searched
Perplexity Any browser, no account needed for basic questions Searches the live web nearly every time and shows its sources Names given, plus every cited domain
Google AI Overviews Type the question into Google search itself Reaches people who never chose to use an assistant Whether an overview appeared at all, and who is linked
Gemini Separate product from AI Overviews, asked directly Different surface, different answer, despite the shared name Names given, and any links offered
Claude Logged-out or fresh conversation More cautious about naming specific businesses Whether it named anyone, and what it asked for instead

Google AI Overviews deserves the extra note. It is not the same product as Gemini, and covering one does not cover the other. Google's documentation on AI features in search treats it as a search surface, which is why it reaches people who would never describe themselves as using AI at all.

Perplexity is the one that teaches you the most per minute, because the citations tell you which pages produced the answer, and the way it chooses those sources is visible in a way the others are not.

Four mistakes that waste the run

One: asking about yourself by name. It feels like the obvious test and it answers a question no buyer is asking. Somebody who types your name has already found you. The run exists to find out what happens when they have not.

Two: improvising the wording. If question four comes out slightly differently on Gemini than on ChatGPT, you have not compared five engines, you have run five separate tests. Copy and paste, every time.

Three: asking once and believing it. The same question asked twice can produce different names. That is normal behavior, not a fault, and it means a single answer is an anecdote. Ask the ones that matter twice and record both, which is the same discipline behind the fifteen-minute check.

Four: recording only yourself. A sheet full of "not named" tells you that you have a problem. A sheet that also lists who was named instead tells you what those businesses have that you do not, which is the only part of the exercise that leads anywhere.

Then date the sheet, save it somewhere you will find it, and put a note in your calendar for a month's time. The second run is where the value is. The first one is just the photograph you will compare it against.

Our free check runs twenty-five buyer questions from your niche at $0 and emails a plain-English readout within the hour, which is the same idea done for you at four times the sample size. It runs as soon as you ask for it.

Questions we hear the most

How do I test my business across all five AI assistants?

Write ten buyer questions in fixed wording, open a logged-out session on each of ChatGPT, Perplexity, Google AI Overviews, Gemini, and Claude, ask all ten on each, and record every business name that comes back. Budget about two and a half hours.

Which five assistants should I test?

ChatGPT, Perplexity, Google AI Overviews, Gemini, and Claude. They cover the surfaces most buyers reach today, and Google AI Overviews matters because people meet it without choosing to use an assistant at all.

Should I ask about my business by name?

Only as a second pass, and treat the result as trivia. Buyers who already know your name are not the ones you are missing. The useful questions describe the problem and ask who can help, with you left out of the wording.

Do I need to be logged out?

Yes, or in a private window. A logged-in assistant may be drawing on your past conversations, which is exactly the personalization your prospective client does not have, and it will flatter you.

Why do the five give different answers?

Because they gather evidence differently. Perplexity searches the live web for nearly every question, while others lean more on what the model already absorbed. The same question can honestly produce five different lists.

How often should I repeat this?

Monthly is enough for most businesses, and quarterly is enough if nothing about your site is changing. What matters is that the wording and the question list stay identical between runs.

What does the AnswerHalo audit do that this afternoon does not?

It runs 25 questions rather than ten across all five engines, stores every answer with a timestamp, ranks the gaps by revenue impact, and names the specific pages and sources to fix first. It costs $500 and arrives by this time tomorrow.

What does the AnswerHalo free check include?

It costs $0. We ask ChatGPT 25 real buyer questions from your niche, then email a plain-English readout within the hour: how many answers named you, who was named instead, and the first fix. It runs as soon as you ask for it.

SEE WHERE YOU STAND

Your buyers are already asking. Find out what AI tells them.

The free check asks ChatGPT 25 real buyer questions about your niche and sends you the report within the hour, at $0. If it shows you are already getting named everywhere, we will say so in plain words.

Get my free check →