For the complete documentation index, see llms.txt. This page is also available as Markdown.

Evaluation AI

This feature lets you correct and retrain your AI whenever an answer misses the mark or isn't relevant. By reviewing or revising the AI's replies directly, you help it learn to be more accurate next time.

  1. Open it from the Chat page

    • Hover over a reply the AI sent.

    • Click the evaluation icon (next to the reply icon).

  2. The evaluation pop-up

    • Once you click the icon, the AI message evaluation pop-up opens.

    • It's filled in automatically with the AI's reply and one customer message as starting context.

  3. Adjust the conversation context

    • If you need to, you can add more messages as context.

    • Click the icon in the top-left corner to show the conversation bubbles, then tick the messages you want to include.

  4. Edit the AI's answer

    • Edit the AI's answer so it says what you think is right.

    • To split the answer into several bubbles, click + to add a new message line.

  5. Revert to the original answer (optional)

    • Changed your mind? Click the revert response icon to bring back the AI's original answer.

  6. Save your changes

    • When you're done editing, click Save to keep your revision.

  7. Manage your evaluations

    • Go to AI Agent > Setting > Evaluation.

    • There you can see your full evaluation history, edit evaluations again, or delete ones you no longer need.

    Also:

    You can evaluate replies from the AI test box on the AI Agent Settings page too, while you're testing the AI's answers yourself. It works the same way, so you can correct the AI's output the moment you spot something off.