Category

How to Review AI 2.0 Agent Conversations in BoldDesk

Updated:

The Conversations section on the BoldDesk AI Agent Builder page provides a history of interactions processed by an AI 2.0 Agent. It helps administrators review customer questions, AI-generated responses, and the context available during each interaction. Reviewing conversations can help identify unclear instructions, missing or outdated knowledge, unexpected AI tool behaviour, unsupported assumptions, and incomplete fallback responses.

This article explains how to access AI 2.0 Agent conversations, review the available interaction details, and use the findings to improve AI Agent configuration.

Prerequisites

Before reviewing AI 2.0 Agent conversations, ensure that:

  • The AI 2.0 Agent has processed at least one interaction.
  • Your AI Agent Builder Access is set to Full Access.
  • You have access to the applicable AI 2.0 Agent.
  • Trace Logging was enabled before the interaction if you need to review detailed execution information.

For permission configuration instructions, explore How to Configure AI Agent Builder Access Permission.

Reviewing AI Agent Conversations

The Conversations section lists interactions processed by the selected AI 2.0 Agent. For each interaction, you can review a message preview, brand, date and time, channel, AI Agent version, customer messages, AI-generated responses, and available trace information.

You can open the Conversations section from the AI Agents page or directly from Agent Builder.

Method 1. Open Conversations from the AI Agents Page

  1. Go to AI Center > AI Agents.

  2. Locate the required AI 2.0 Agent.

  3. Open More options.

  4. Select View Conversations.

    Option_to_View_an_AI_Agents_Conversation.png

Method 2. Open Conversations from Agent Builder

  1. Open the required AI 2.0 Agent in Agent Builder.

  2. Under Channels in the left navigation menu, select Conversations.

    Conversations_Section_of_an_AI_Agent_Configuration_Area.png

Find and Review a Conversation

After opening Conversations:

  1. Use Search to locate the required conversation, if necessary.

  2. Review the conversation preview, brand, date and time, channel, and AI Agent version.

  3. Select a conversation from the list.

  4. Review the customer messages and AI-generated responses in the conversation details panel.

    Conversations_Page_of_an_AI_Agent.png

  • The version displayed for a conversation identifies the AI 2.0 Agent version that processed the interaction.
  • If the selected AI 2.0 Agent has not processed any interactions, the page displays “Conversation hasn’t started yet”.

Review Conversation Details

A selected conversation can provide the following information:

Information Description
Conversation preview Displays a shortened preview of the interaction.
Brand Identifies the brand associated with the conversation.
Date and time Shows when the interaction occurred.
Channel Identifies the source through which the interaction occurred.
AI Agent version Identifies the published version that processed the interaction.
Conversation messages Displays the available customer messages and AI-generated responses.
Traces Provides execution details for an AI-generated response, when available.
Delete conversation Removes the selected conversation record.

Review the complete conversation because earlier messages can affect how the AI 2.0 Agent interprets and answers later requests.

Review AI Traces

AI Traces provide execution-level information about an AI-generated response.

To review AI Traces:

  1. Open the required conversation.

  2. Locate the applicable AI-generated response.

  3. Select the Traces icon below the response.

    Traces_Icon.png

  4. Review the Overview section.

  5. Expand the required entries under Traces.

  6. Close the panel after completing the review.

    Traces_page_for_an_AI_Agent.png

AI Trace Overview

Field Description
Status Indicates whether the AI execution completed successfully.
Session ID Identifies the conversation session associated with the execution.
Message ID Identifies the individual message being traced.
Duration Shows the total execution time in milliseconds.
Start time Shows when AI processing started.
End time Shows when AI processing ended.
Agent ID Identifies the AI 2.0 Agent that processed the message.

AI Trace Stages

Trace Stage Description
agent.run Represents the complete AI Agent execution.
memory.history.load Loads available conversation history.
agent.initialize Initializes the AI Agent and its configuration.
agent.invoke Processes the request and generates the response.
memory.history.save Saves the applicable interaction to conversation history.
details Provides additional execution information for the trace stage, when available.
  • AI Traces can contain customer messages, execution identifiers, system context, tool inputs, and tool responses. Handle trace information according to your organisation’s privacy, security, and data-retention requirements.
  • Each trace stage displays its execution duration. Detailed trace information is available only when the applicable Trace Logging options were enabled before the interaction.

Delete an AI Agent Conversation

To delete a conversation:

  1. Open Conversations for the required AI 2.0 Agent.

  2. Select the conversation you want to remove.

  3. Click Delete conversation.

    Option_to_Delete_a_Conversation.png

  4. Review the confirmation message.

  5. Confirm the deletion.

    Dialog_to_Delete_a_Conversation.png

Deleting a conversation permanently removes information that might be required for troubleshooting, auditing, compliance, or response-quality review. Review the conversation and its associated AI Traces before confirming the deletion.

Use Conversations and Traces to Improve the AI Agent

Use the conversation history and AI Traces to identify which part of the AI 2.0 Agent configuration requires improvement.

Finding Configuration to Review
The response does not follow the expected tone or structure Instructions
The response contains unsupported or hallucinated information Instructions, Libraries, and Grounded response only
The AI 2.0 Agent cannot find an answer Libraries and Fallback instruction
The wrong AI Tool is used AI Tools and tool-use instructions
A required AI Tool is not used Linked MCP Servers, API Actions, and instructions
An AI Tool invocation fails AI Tool configuration and Log Tool Responses
Relevant earlier messages are omitted History message limit and the memory.history.load trace
The response does not include enough retrieved knowledge Number of Chunks and linked Libraries
The response is incomplete or too short Max output tokens
The fallback response is unsuitable Fallback instruction
AI execution takes longer than expected Trace-stage durations, particularly agent.invoke
Conversation history is not loaded or saved correctly memory.history.load and memory.history.save traces
The AI execution fails Trace Status and the applicable failed trace stage

Troubleshooting

AI Traces Are Not Available

If AI Traces are not displayed for a conversation, confirm that:

  • Trace Logging was enabled before the interaction occurred.
  • The required LLM Tracing or Tool Tracing options were enabled.
  • The selected message is an AI-generated response.
  • You have access to the applicable AI 2.0 Agent.

Enabling Trace Logging does not generate trace information for interactions that occurred before the setting was enabled.

An AI Trace Stage Shows a Failure

If a trace stage reports a failure:

  1. Open the applicable trace.
  2. Expand the failed trace stage.
  3. Review the available error details and execution information.

Depending on the failed stage:

Failed Stage Recommended Review
memory.history.load Review conversation-history settings and available conversation history.
memory.history.save Review conversation-history settings and storage configuration.
agent.initialize Review AI Agent configuration, linked resources, and initialization settings.
agent.invoke Review AI Agent instructions, model availability, execution controls, and input context.
Tool-related traces Review the linked MCP Server, API Action, tool configuration, and tool response logs.

If the customer receives an error response or fallback response, review the configured Custom Error Message and Fallback Instruction.

AI Tool Activity Is Not Displayed

If AI Tool activity is not displayed in traces, confirm that:

  • The AI 2.0 Agent invoked an AI Tool during the selected interaction.
  • The MCP Server or API Action was linked to the AI Agent version that processed the interaction.
  • Log Tool Schemas and Log Tool Responses were enabled.
  • The interaction occurred after Tool Tracing was enabled.

The AI Agent Returns Unexpected Responses

If the AI Agent generates inaccurate, inconsistent, or unexpected responses:

  • Review the conversation history to understand the customer intent and available context.
  • Review the configured Instructions for unclear, conflicting, or incomplete guidance.
  • Verify that the required knowledge exists in the linked Libraries.
  • Review trace details to determine whether the correct knowledge sources and tools were used.
  • Confirm that Grounded response only is enabled if responses should be limited to available knowledge.

The AI Agent Cannot Answer Questions That Exist in Libraries

If the AI Agent cannot answer questions that are covered by existing knowledge:

  • Verify that the correct Libraries are linked to the AI Agent.
  • Review the retrieval-related trace details.
  • Increase the Number of Chunks, if appropriate.
  • Confirm that the required content exists, is published, and is up to date.
  • Review the response and trace information to determine whether the AI Agent retrieved the expected knowledge.

Responses Are Missing Relevant Conversation Context

If the AI Agent appears to ignore earlier messages:

  • Review the memory.history.load trace stage.
  • Confirm that conversation history was loaded successfully.
  • Review the configured History message limit.
  • Check whether the required messages fall outside the loaded history range.

AI Responses Are Slow

If AI-generated responses take longer than expected:

  • Review the overall trace Duration.
  • Review execution times for each trace stage.
  • Identify whether delays occur during agent.invoke, tool execution, or knowledge retrieval.
  • Review linked tools, MCP Servers, API Actions, and model settings that may increase execution time.

Fallback Responses Occur More Frequently Than Expected

If the AI Agent frequently returns fallback responses:

  • Review the conversation and trace details to determine why a response could not be generated.
  • Verify that the required knowledge is available in linked Libraries.
  • Review AI Tool configuration and tool availability.
  • Review the configured Fallback Instruction.
  • Check for tool failures, retrieval failures, or instruction conflicts in the trace data.

Frequently Asked Questions

  1. Where can I view AI 2.0 Agent conversations?
    Go to AI Center > AI Agents, open More options for the required AI 2.0 Agent, and select View Conversations.

  2. Can I review AI execution details for a response?
    Yes. Click the Traces icon below the applicable AI-generated response.

  3. What information is available in AI Traces?
    AI Traces can display the execution status, Session ID, Message ID, duration, start and end times, Agent ID, and individual execution stages.

  4. What do the trace-stage durations represent?
    Each duration indicates how long the corresponding execution stage took. For example, agent.invoke shows the time spent processing the request and generating the response.

  5. How do I apply improvements identified from a conversation?
    Update an editable draft, test the changes in Playground, publish the updated version, verify its channel mapping, and monitor new conversations.

Related Articles

  1. How to Test an AI 2.0 Agent in BoldDesk
  2. AI Agent Versioning in BoldDesk AI 2.0
  3. How to Configure AI Agent Builder Access Permission
Was this article useful?
Like
Dislike
Help us improve this page
Please provide feedback or comments
Comments (0)
Access denied
Access denied
Access denied
Access denied

No articles or sections found
No articles or sections found