Home/HighLevel/Features/AI Employee/HighLevel knowledge base retrieval tester: how to set up and run

AI

HighLevel knowledge base retrieval tester: how to set up and run

In short

The Knowledge Base Retrieval Tester lets you check how well your HighLevel Knowledge Base finds answers to sample questions. It shows the sources and chunks returned, so you can spot missing or irrelevant content before live AI interactions.

AreaAI Employee · Knowledge Bases
Used forAI Employee development, Customer support knowledge base, Conversation bot preparation
Setup steps10 steps in 1 task
Last updatedNovember 17, 2026

01Who this is for

  • AI Employee developers, they can verify that uploaded documents and tables are searchable before agents go live.
  • Support teams, they can confirm that policy articles and FAQ entries return the correct information for customer queries.

02Knowledge Base retrieval tester, explained

The Retrieval Tester runs a read only simulation of a user question against a selected Knowledge Base. It returns an answer generated by the platform and lists each source or chunk that contributed to the answer. This view lets you understand which pieces of content the AI considered.

The tester lives inside the Knowledge Base editor. After opening a Knowledge Base, you open the Retrieval Tester panel, type a question, and view the answer with its source list. No changes are written to the Knowledge Base and no live conversations are triggered.

The feature works with all supported source types: uploaded documents, rich text articles, CSV tables, and web crawled pages. Content must be fully indexed before the test runs, otherwise no sources will appear.

03How businesses use Knowledge Base retrieval tester

  • AI Employee development. The developer opens the Knowledge Base, launches the Retrieval Tester, and asks typical client questions. By reviewing the returned sources, they confirm that the employee can locate the needed documents before publishing.
  • Customer support knowledge base. A support manager runs the tester with common ticket topics. The manager checks that the most relevant policy article appears in the source list and updates any missing or outdated entries.
  • Conversation bot preparation. The bot creator runs the Retrieval Tester after adding new FAQ rows to a table. They verify that the bot can retrieve the correct table row for a query like “Which customers have overdue invoices?” and adjust the table if needed.

04The numbers and rules that matter

  • Supported source types include documents, rich text content, tables, website or web crawler content, and other supported Knowledge Base source types.

05Before you start

  • The Knowledge Base must contain the documents, rich text, tables, or web sources you intend to test.
  • All added or updated content must finish processing and be indexed before running the tester.

06How to set up and use Knowledge Base retrieval tester in HighLevel

Set up and run Knowledge Base Retrieval Tester

  1. Navigate to AI Agents > Knowledge Base.
  2. Open the Knowledge Base you want to test.
  3. Confirm the Knowledge Base includes the desired sources such as documents, rich text content, tables, website or web crawler content, and any other supported types.
  4. Wait for any newly added or updated content to finish processing or indexing.
  5. Open the Knowledge Base Retrieval Tester.
  6. Enter a realistic customer style question, for example “What is your refund policy?”.
  7. Review the answer that is generated.
  8. Examine the list of retrieved sources and chunks shown with the answer.
  9. Update the Knowledge Base content if the results are missing, incomplete, outdated, or irrelevant.
  10. Retest the same question to confirm the updated content is now retrieved correctly.

07What it looks like in HighLevel

08Things to know before you rely on it

  • The tester runs in read only mode; it does not modify Knowledge Base content.
  • Testing does not send messages to customers or trigger live conversations.
  • Only supported source types, documents, rich text, tables, and web crawled pages, can be evaluated.

09If something goes wrong

  • No source is retrieved. Confirm that indexing is complete, then add clearer wording that matches how users ask the question.
  • Wrong source is retrieved. Update, remove, or clarify the competing content so the intended source appears more relevant.
  • Answer is incomplete. Add missing details to the relevant Knowledge Base entry.
  • Outdated source is retrieved. Remove or update the outdated content.
  • Table data is not returned. Confirm the CSV setup, selected columns, and processing status.
  • Document content is missing. Review headings, formatting, and source quality, then re upload or revise the document.
  • Results improve after rewording the question. Add natural language terms, synonyms, and clearer headings to the Knowledge Base.

10How it connects to the rest of HighLevel

Michael's take

Michael Reimer
Michael ReimerFounder of CRM Pros, HighLevel Commander and Certified Admin

When a new policy or support document lands in your Knowledge Base, you need to be sure customers get the right answer, not a vague or outdated snippet. The first thing I would lock down is that the source I just added is actually indexed, I check the Retrieval Tester right after upload to confirm the document shows up.

If the test shows the wrong chunk or no result at all, I tweak headings or add the common phrasing customers use, then run the same question again. A quick cycle of test update retest saves you from surprising live errors once the AI Employee goes public.

Get More InformationOpens on HighLevelPublished November 2, 2026 · Updated November 17, 2026

Common questions

Common questions about Knowledge Base retrieval tester.

Does the Knowledge Base Retrieval Tester change my Knowledge Base?

No. The tester runs as a read only simulation and does not edit, delete, or update any Knowledge Base content.

Will testing affect live customer conversations?

No. Running the Retrieval Tester does not send messages to customers or trigger live chats.

Can I use the tester before launching an AI Employee or bot?

Yes. The tool is intended to validate Knowledge Base quality before connecting it to live AI experiences.

Is the Retrieval Tester the same as testing a Conversation AI bot?

No. The tester only checks whether Knowledge Base content can be found. Bot testing also evaluates prompts, actions, and response behavior.

What types of content can I test with the Retrieval Tester?

You can test documents, rich text entries, CSV tables, and web crawled sources that are supported by the Knowledge Base.

Next step

Pick the features that matter. Then get the plan that unlocks them.

Explore the features you want, start with the five at the top, and upgrade through my link when you are ready. The bonuses and the team come with it.

The features directory explains every HighLevel feature in plain English. Browse it to see what the platform can do.

Back to the FeaturesSee the full details
⌃

Site preview

Explore the next page

This destination is reserved in the page inventory and is not built yet.