Asset 20 8 2
Does AI recommend your business? Run the free check →

Join 15,000 business owners, marketers and entrepreneurs. The Sunday newsletter you'll be annoyed only arrives once a week.

Article

What Is AI Hallucination? How to Spot It and Reduce It

An AI hallucination is when an AI tool gives false or made-up information as if it were fact, in a confident, polished tone. It happens because language models predict likely words rather than check truth. The part people miss: you can reduce it, but never remove it, so check what matters.

You ask an AI assistant a simple question and it gives you a polished, confident answer. Then you check, and half the detail was invented. That's an AI hallucination, and every regular user meets one sooner or later. I want you to spot them quickly and to know the habits that cut them down.

AI hallucination explained in everyday terms

Wikipedia describes an AI hallucination as output containing false or misleading information presented as fact. IBM puts it as answers that seem believable but are factually wrong, irrelevant or entirely fabricated.

The tricky part is the tone. A hallucinated answer doesn't come with a warning label. It reads just as smoothly as a correct one, with tidy sentences, specific names and a reassuring confidence.

Why AI tools hallucinate

It comes down to how they work. Wikipedia says large language models are pretrained to predict the next word, which can push them to guess when they lack the information. IBM explains that the model predicts text that fits its training patterns, with no built-in check on whether it's true.

Other causes Wikipedia lists include incomplete, inaccurate or unrepresentative training data, with models often repeating common misconceptions. Vague questions don't help either, because a loose prompt invites a guess.

If you're curious about the knowledge side, my piece on where ChatGPT gets its information fills in the background.

Real examples of AI hallucinations

  • Invented court cases. In the case Mata v. Avianca, a lawyer submitted six fake case precedents generated by ChatGPT, according to Wikipedia. IBM also cites a US lawyer whose filing cited cases that turned out to be fictitious.
  • Fabricated references. Wikipedia reports a research tool, Galactica, that was withdrawn after it cited a fictitious paper.
  • Confident but wrong business details. Opening hours, policies and statistics are classic places for an assistant to fill a gap with something plausible.

Whatever the field, the pattern repeats: specific-sounding detail with nothing behind it.

How to spot an AI hallucination

You don't need technical skills. Watch for these warning signs:

  • Quotes, statistics or studies with no source you can open.
  • Names, dates or job titles that you can't find anywhere else.
  • Links or references that lead nowhere or to something unrelated.
  • An answer that's oddly perfect for exactly what you wanted to hear.
  • A different answer when you ask the same question twice.

The last one is a favourite of mine. Anthropic's docs suggest running the same prompt several times and comparing results, because inconsistencies can signal a hallucination.

How to reduce hallucinations when you use ChatGPT, Claude or Gemini

No technique removes the problem completely. Anthropic's own guidance says its methods significantly reduce hallucinations but don't eliminate them, so always validate critical information. These habits stack well:

  1. Give permission to say "I don't know". Anthropic's docs recommend explicitly allowing the model to admit uncertainty, and IBM suggests rules like "if unsure, say you don't know".
  2. Supply the facts yourself. Paste in your own document and tell the assistant to use only that. Anthropic suggests restricting the model to the information provided.
  3. Ask for quotes first. For long documents, Anthropic recommends having the model pull out word-for-word quotes before it answers.
  4. Ask for sources, then check them. A source that's real and says what the assistant claims is the best test. If it can't find a supporting quote, the claim should be dropped.
  5. Be specific. A clear, structured request leaves less room for guessing.

Better instructions help a lot, and my guide to writing ChatGPT prompts for business tasks gives you a structure to copy.

Tools that look things up reduce AI hallucination

Wikipedia and IBM both describe retrieval-augmented generation. In plain terms, the assistant consults trusted documents or other sources before answering, rather than relying only on what it absorbed in training. Some assistants offer this through web search or by letting you attach files. The answers still need checking, but they're easier to trace back to a source.

This ties into a common frustration: an assistant that doesn't know your business will fill the gaps. I cover how to fix that in what to do when ChatGPT is missing your business details.

Work with me

Want AI doing the heavy lifting in your marketing?

I build the systems that handle the boring 80 percent, so you get your week back. Done properly, with the human kept in.

Where human review matters most with AI hallucination

IBM's advice is to treat AI as a drafting assistant rather than an authority, with people reviewing high-stakes outputs. That's sensible for a small business. Take extra care with anything legal, medical, financial or technical, anything that names a real person or company, and anything a customer will read.

A quick rule I use: the more it matters, the more you check. A rough brainstorm can go straight in your notes. A claim on your website needs a source.

Assistants get facts about businesses wrong too, and you can test your own with this walkthrough for checking what ChatGPT says about your business.

Is hallucination the right word?

Some critics dislike the term. Wikipedia notes that they call it anthropomorphic, since a machine doesn't perceive anything, and suggest alternatives such as confabulation or fabrication. Whatever label you prefer, the practical meaning is the same: confident output that isn't true.

If you'd like help building checking habits into how your team uses AI, that's part of my work as an AI consultant.

Frequently asked questions

What is an AI hallucination?

It's output that contains false or misleading information presented as fact. The answer sounds confident and convincing even though some of the detail has been invented.

Why does ChatGPT make things up?

Language models are trained to predict likely next words, which can lead them to guess when they lack the information. They don't automatically check facts.

How can I tell if an AI answer is a hallucination?

Check quotes, statistics, names and links against sources you can open yourself. Be suspicious of specific detail you can't verify anywhere else.

How do I stop AI hallucinations?

You can reduce them but not remove them. Give the tool your own documents, allow it to say it doesn't know, ask for quotes and sources, and check the important parts yourself.

Do all AI tools hallucinate?

Vendors including Anthropic say even advanced models can produce text that is factually incorrect, so it's wise to treat every assistant the same way.

Is hallucination the same as lying?

No. Lying needs intent. The model is generating likely-sounding text, which is why some critics prefer the word confabulation.

Published and maintained by the Lilach Bullock team, covering marketing, AI and business growth.
Your buyers are asking AI who to use. Does it say you?

See for free whether ChatGPT, Claude, Perplexity, Gemini and Google name you, and get the plan to become the answer.

Check my AI visibility →
Sundays only

Get the Sunday newsletter.

One email a week. AI experiments, marketing tactics, and the workflows Lilach is building right now in her own business.

Subscribe free

Let’s get your marketing running on AI.

Book a free 30-minute call

We figure out what you need, where AI fits in, and what working together would look like.

Book the call →

Or take the 30-second calculator

You’ll see the hours and the money quietly leaking out of your week, and the three workflows worth building first.

Take the calculator →

Or grab the free AI resource library

Prompt packs, templates, checklists, and swipe files. The exact tools I build for paying clients. Yours, free.

Get the library →
Keep reading

More from the blog.