Home/HighLevel/Features/AI Employee/Optimizing Conversation AI prompts from a trial chat in HighLevel

AI

Optimizing Conversation AI prompts from a trial chat in HighLevel

In short

The Trial Chat Prompt Optimizer lets you improve a Conversation AI agent by using a completed test chat. It takes the current prompt, saved or not, and runs automated scenarios to suggest better wording. You can examine results, pick a variation, and then save the updated prompt.

AreaAI Employee · Conversation AI
Used forReal estate agency, Online tutoring service, Ecommerce store
Setup steps20 steps in 4 tasks
Last updatedNovember 17, 2026

01Who this is for

  • Team members who build and manage Conversation AI agents.
  • Users who need to test and refine bot prompts before publishing them live.

02Trial chat Prompt Optimizer, explained

The optimizer lives inside the Conversation AI builder under the Test your agent panel. After sending a test message and receiving a reply, an Optimize Prompt button appears. Clicking it launches a background run that creates test scenarios, evaluates the agent with an evaluation copy, and returns multiple prompt variations.

During the run, the system records accuracy scores, scenario lists, transcript samples, evaluation reasoning, and the differences between the original and suggested prompts. You can watch progress in the builder or open a dedicated Prompt Optimizer view. Results stay available even after the trial chat is cleared, allowing later review and application.

03How businesses use trial chat Prompt Optimizer

  • Real estate agency. The agency runs a trial chat with its property inquiry bot, clicks Optimize Prompt, and reviews the suggested wording that better captures buyer preferences. After confirming the change, the agent saves the new prompt to improve future interactions.
  • Online tutoring service. A tutor service tests a scheduling bot, uses the optimizer to generate prompt variations that reduce booking errors, examines the accuracy and transcript details, and applies the best variation before publishing the bot.
  • Ecommerce store. The store sends a sample purchase help question, runs the optimizer, checks the evaluation reasoning to ensure no unwanted upsell language appears, selects the preferred prompt, and saves the updated instructions for live chat.

04Before you start

  • Enable the Conversations AI Prompt Optimizer Labs feature.
  • Have permission to manage the Conversations AI agent.
  • Ensure the trial chat contains at least one user message and one agent reply.

05How to set up and use trial chat Prompt Optimizer in HighLevel

Start a trial chat

  1. Open AI Agents › Conversation AI.
  2. Select the agent you want to improve.
  3. Go to the Agent builder and locate the Test your agent area.
  4. Send a realistic customer message to the agent.
  5. After the reply appears, click Optimize Prompt.

Run the optimization

  1. Read the usage details shown for the optimizer.
  2. Start the optimization run.
  3. Watch progress inside the builder or open Prompt Optimizer for more detail.
  4. Allow the system to create scenarios and evaluate prompt variations.
  5. If needed, stop remaining work without losing completed results.

Review optimization results

  1. Open the results view for the completed run.
  2. Select the strongest variation displayed.
  3. Examine accuracy scores, scenario list, and chat transcripts.
  4. Read the evaluation reasoning and the prompt difference summary.
  5. Confirm the suggested changes meet your requirements.

Apply and save the optimized prompt

  1. Choose the preferred prompt variation.
  2. Apply that variation to the Conversations AI builder.
  3. Inspect the updated instruction text.
  4. Click Save to make the changes live.
  5. Run another test message to verify the new behavior.

06What it looks like in HighLevel

07Settings that matter

  • Conversations AI Prompt Optimizer Labs feature. Controls whether the Optimize Prompt button is available in the builder. The feature must be turned on for the optimizer to run.

08Things to know before you rely on it

  • The Optimize Prompt button only appears after the agent has replied to a test message.
  • Configured actions, such as workflow triggers or calendar bookings, may still execute during testing because an evaluation copy of the agent is used.
  • A higher accuracy score does not guarantee flawless performance; review all supporting data before applying changes.
  • Optimization runs can be stopped, but any completed variations are retained.

09If something goes wrong

  • Optimize Prompt button does not appear.. Confirm that the Conversations AI Prompt Optimizer Labs feature is enabled, you have permission to manage the agent, and the trial chat includes at least one user message and one agent reply.
  • Real world actions run during optimization testing.. Review connected workflows, calendars, and other resources beforehand and use test resources where possible.

10How it connects to the rest of HighLevel

Michael's take

Michael Reimer
Michael ReimerFounder of CRM Pros, HighLevel Commander and Certified Admin

Trial chat Prompt Optimizer is a small convenience that can feel like a real shift for teams that rely on AI Agents to answer customer queries. It lets you turn a single test chat into a full prompt improvement loop, so you can fine tune responses without publishing changes first.

You can tweak the bot’s wording, see how the new prompt performs in simulated scenarios, and only push the change when you’re sure it fixes the issue. If I were setting it up, I’d run a quick test chat, let the optimizer suggest a variation, and verify that no unwanted actions fire before saving the new prompt.

Get More InformationOpens on HighLevelPublished November 3, 2026 · Updated November 17, 2026

Common questions

Common questions about trial chat Prompt Optimizer.

Can I run the optimizer without saving my latest prompt edits?

Yes. The optimizer uses the prompt currently shown in the builder, including any unsaved changes.

What happens to the trial chat after I start an optimization run?

The trial conversation may be cleared, but the optimization run stays available in the Execution History for later review.

Is applying an optimized prompt enough to make it live?

No. Applying the variation updates the builder, but you must click Save on the agent to publish the changes.

Can I stop an optimization run once it has started?

Yes. You can stop the remaining work without losing any variations that have already completed.

Will real actions, like workflow triggers, run during the optimization test?

Configured actions may still execute because the test uses an evaluation copy of the agent. Review your connected resources before starting.

Next step

Pick the features that matter. Then get the plan that unlocks them.

Explore the features you want, start with the five at the top, and upgrade through my link when you are ready. The bonuses and the team come with it.

The features directory explains every HighLevel feature in plain English. Browse it to see what the platform can do.

Back to the FeaturesSee the full details
⌃

Site preview

Explore the next page

This destination is reserved in the page inventory and is not built yet.