AI Chatbot Glossary

What Is an AI Hallucination?

Definition

An AI hallucination is a response from an AI model that sounds confident but is false, unsupported, or made up, such as an invented price or policy.

An AI hallucination happens when a model produces information that is not true and presents it as fact. The model is not lying in any human sense. A large language model (LLM) writes the most likely next words, and sometimes the most likely-sounding answer is simply wrong. The U.S. National Institute of Standards and Technology lists this as a core generative AI risk, under the name “confabulation,” in its 2024 generative AI risk profile.

What Hallucinations Look Like on a Business Site

On a company website, hallucinations rarely look dramatic. They look like ordinary, helpful answers with one wrong detail.

  • A discount or free consultation that you never offered.
  • Opening hours from a different branch or an old version of the page.
  • A refund policy that sounds reasonable but does not match yours.
  • A service you do not provide, described as if you do.

The cost can go beyond embarrassment. In Moffatt v. Air Canada, a 2024 tribunal decision in British Columbia, the airline was held responsible for a bereavement fare policy its website chatbot described incorrectly and was ordered to pay the customer.

Why They Happen

Most hallucinations trace back to a model being asked something it has no source for. If the question falls outside the content provided, the model fills the silence. Vague or contradictory pages make it worse, as does a prompt that pushes the bot to always give an answer. This is the main weakness of using a general assistant in place of a site-specific one, a trade-off covered in ChatGPT vs a custom website chatbot.

How to Reduce Them

You cannot drive the rate to zero, but you can make wrong answers rare. Use retrieval-augmented generation (RAG) so replies come from your pages, keep those pages current, and instruct the bot to admit when it does not know. AI Chatbot answers from the chatbot knowledge base you build from selected pages and includes a handoff form for questions it should pass to you, both described on the AI Chatbot features page.

Back to the AI Chatbot Glossary