Sign in Start free
AI SEARCH (GEO)

Compare assistant answers against your page

Use when an assistant answers a question about you and you want to know where it got it wrong.

assistant-answer-diff.md
Download .md
You are comparing an AI assistant's answer against the source page it should have used.

The question asked: {{QUESTION}}
The assistant's answer: {{ASSISTANT_ANSWER}}
Our page content: {{PAGE_TEXT}}

Produce:
1. A table: | Statement in the answer | Present on our page? (verbatim quote or "absent") | Verdict (accurate / distorted / outdated / fabricated / from elsewhere) | Likely cause |
2. A list of things our page says that the answer omitted, ranked by how much the omission changes the meaning.
3. For each distorted or fabricated statement, the exact sentence to add or change on our page to make the correct version easier to lift than the wrong one.
4. A one-paragraph summary of the single structural reason the answer went wrong, if there is one.

Constraints:
- Break the assistant answer into individual statements before judging. Do not assess it as a whole.
- Quote our page verbatim in column two, or write "absent". No paraphrasing.
- Do not assume malice or model failure where an ambiguous sentence on our page explains it.
- Do not recommend contacting the model provider.

Fill in before running

Replace each placeholder with your own detail. The more specific you are, the less the model invents.

  • {{QUESTION}}
  • {{ASSISTANT_ANSWER}}
  • {{PAGE_TEXT}}

Getting a better result

  1. Most distortions trace back to one ambiguous sentence, so look for the shared cause before fixing individually.
  2. Save the assistant answer with a date; you will want the before and after.
  3. "From elsewhere" verdicts tell you which third-party page is outranking yours as a source.

Questions about this prompt

When do I use this rather than the brand description test?

When you have a specific wrong answer in front of you and the page it should have come from. The description test produces the answer; this explains it. Use it when the answer is wrong in a way you can point at, not when it is merely thinner than you hoped.

What do I need in front of me?

The assistant answer copied verbatim, the question exactly as asked, and the page you believe should have been used. Paraphrasing the answer defeats the method, since statements are judged one at a time against your page text. Save both with a date, because you will want the before and after.

What comes back, and which part is the finding?

A statement by statement verdict table, ranked omissions, the exact sentence to change for each distortion, and a paragraph naming the single structural cause. Read that paragraph first. Verdicts of from elsewhere are the other prize, since they name the third-party page currently beating yours as a source.

What is the mistake that costs me?

Fixing each distorted statement separately. Most trace back to one ambiguous sentence on your page, and patching symptoms leaves that sentence in place to cause the next set. The other wasted move is treating a fabrication as a model fault when an ambiguous sentence of your own explains it.