How to Review AI 2.0 Agent Conversations in BoldDesk
The Conversations section on the BoldDesk AI Agent Builder page provides a history of interactions processed by an AI 2.0 Agent. It helps administrators review customer questions, AI-generated responses, and the context available during each interaction. Reviewing conversations can help identify unclear instructions, missing or outdated knowledge, unexpected AI tool behaviour, unsupported assumptions, and incomplete fallback responses.
This article explains how to access AI 2.0 Agent conversations, review the available interaction details, and use the findings to improve AI Agent configuration.
Prerequisites
Before reviewing AI 2.0 Agent conversations, ensure that:
- The AI 2.0 Agent has processed at least one interaction.
- Your AI Agent Builder Access is set to Full Access.
- You have access to the applicable AI 2.0 Agent.
- Trace Logging was enabled before the interaction if you need to review detailed execution information.
For permission configuration instructions, explore How to Configure AI Agent Builder Access Permission.
Reviewing AI Agent Conversations
The Conversations section lists interactions processed by the selected AI 2.0 Agent. For each interaction, you can review a message preview, brand, date and time, channel, AI Agent version, customer messages, AI-generated responses, and available trace information.
You can open the Conversations section from the AI Agents page or directly from Agent Builder.
Method 1. Open Conversations from the AI Agents Page
-
Go to AI Center > AI Agents.
-
Locate the required AI 2.0 Agent.
-
Open More options.
-
Select View Conversations.
Method 2. Open Conversations from Agent Builder
-
Open the required AI 2.0 Agent in Agent Builder.
-
Under Channels in the left navigation menu, select Conversations.
Find and Review a Conversation
After opening Conversations:
-
Use Search to locate the required conversation, if necessary.
-
Review the conversation preview, brand, date and time, channel, and AI Agent version.
-
Select a conversation from the list.
-
Review the customer messages and AI-generated responses in the conversation details panel.
- The version displayed for a conversation identifies the AI 2.0 Agent version that processed the interaction.
- If the selected AI 2.0 Agent has not processed any interactions, the page displays “Conversation hasn’t started yet”.
Review Conversation Details
A selected conversation can provide the following information:
| Information | Description |
|---|---|
| Conversation preview | Displays a shortened preview of the interaction. |
| Brand | Identifies the brand associated with the conversation. |
| Date and time | Shows when the interaction occurred. |
| Channel | Identifies the source through which the interaction occurred. |
| AI Agent version | Identifies the published version that processed the interaction. |
| Conversation messages | Displays the available customer messages and AI-generated responses. |
| Traces | Provides execution details for an AI-generated response, when available. |
| Delete conversation | Removes the selected conversation record. |
Review the complete conversation because earlier messages can affect how the AI 2.0 Agent interprets and answers later requests.
Review AI Traces
AI Traces provide execution-level information about an AI-generated response.
To review AI Traces:
-
Open the required conversation.
-
Locate the applicable AI-generated response.
-
Select the Traces icon below the response.
-
Review the Overview section.
-
Expand the required entries under Traces.
-
Close the panel after completing the review.
AI Trace Overview
| Field | Description |
|---|---|
| Status | Indicates whether the AI execution completed successfully. |
| Session ID | Identifies the conversation session associated with the execution. |
| Message ID | Identifies the individual message being traced. |
| Duration | Shows the total execution time in milliseconds. |
| Start time | Shows when AI processing started. |
| End time | Shows when AI processing ended. |
| Agent ID | Identifies the AI 2.0 Agent that processed the message. |
AI Trace Stages
| Trace Stage | Description |
|---|---|
| agent.run | Represents the complete AI Agent execution. |
| memory.history.load | Loads available conversation history. |
| agent.initialize | Initializes the AI Agent and its configuration. |
| agent.invoke | Processes the request and generates the response. |
| memory.history.save | Saves the applicable interaction to conversation history. |
| details | Provides additional execution information for the trace stage, when available. |
- AI Traces can contain customer messages, execution identifiers, system context, tool inputs, and tool responses. Handle trace information according to your organisation’s privacy, security, and data-retention requirements.
- Each trace stage displays its execution duration. Detailed trace information is available only when the applicable Trace Logging options were enabled before the interaction.
Delete an AI Agent Conversation
To delete a conversation:
-
Open Conversations for the required AI 2.0 Agent.
-
Select the conversation you want to remove.
-
Click Delete conversation.
-
Review the confirmation message.
-
Confirm the deletion.
Deleting a conversation permanently removes information that might be required for troubleshooting, auditing, compliance, or response-quality review. Review the conversation and its associated AI Traces before confirming the deletion.
Use Conversations and Traces to Improve the AI Agent
Use the conversation history and AI Traces to identify which part of the AI 2.0 Agent configuration requires improvement.
| Finding | Configuration to Review |
|---|---|
| The response does not follow the expected tone or structure | Instructions |
| The response contains unsupported or hallucinated information | Instructions, Libraries, and Grounded response only |
| The AI 2.0 Agent cannot find an answer | Libraries and Fallback instruction |
| The wrong AI Tool is used | AI Tools and tool-use instructions |
| A required AI Tool is not used | Linked MCP Servers, API Actions, and instructions |
| An AI Tool invocation fails | AI Tool configuration and Log Tool Responses |
| Relevant earlier messages are omitted | History message limit and the memory.history.load trace |
| The response does not include enough retrieved knowledge | Number of Chunks and linked Libraries |
| The response is incomplete or too short | Max output tokens |
| The fallback response is unsuitable | Fallback instruction |
| AI execution takes longer than expected | Trace-stage durations, particularly agent.invoke |
| Conversation history is not loaded or saved correctly | memory.history.load and memory.history.save traces |
| The AI execution fails | Trace Status and the applicable failed trace stage |
Troubleshooting
AI Traces Are Not Available
If AI Traces are not displayed for a conversation, confirm that:
- Trace Logging was enabled before the interaction occurred.
- The required LLM Tracing or Tool Tracing options were enabled.
- The selected message is an AI-generated response.
- You have access to the applicable AI 2.0 Agent.
Enabling Trace Logging does not generate trace information for interactions that occurred before the setting was enabled.
An AI Trace Stage Shows a Failure
If a trace stage reports a failure:
- Open the applicable trace.
- Expand the failed trace stage.
- Review the available error details and execution information.
Depending on the failed stage:
| Failed Stage | Recommended Review |
|---|---|
memory.history.load |
Review conversation-history settings and available conversation history. |
memory.history.save |
Review conversation-history settings and storage configuration. |
agent.initialize |
Review AI Agent configuration, linked resources, and initialization settings. |
agent.invoke |
Review AI Agent instructions, model availability, execution controls, and input context. |
| Tool-related traces | Review the linked MCP Server, API Action, tool configuration, and tool response logs. |
If the customer receives an error response or fallback response, review the configured Custom Error Message and Fallback Instruction.
AI Tool Activity Is Not Displayed
If AI Tool activity is not displayed in traces, confirm that:
- The AI 2.0 Agent invoked an AI Tool during the selected interaction.
- The MCP Server or API Action was linked to the AI Agent version that processed the interaction.
- Log Tool Schemas and Log Tool Responses were enabled.
- The interaction occurred after Tool Tracing was enabled.
The AI Agent Returns Unexpected Responses
If the AI Agent generates inaccurate, inconsistent, or unexpected responses:
- Review the conversation history to understand the customer intent and available context.
- Review the configured Instructions for unclear, conflicting, or incomplete guidance.
- Verify that the required knowledge exists in the linked Libraries.
- Review trace details to determine whether the correct knowledge sources and tools were used.
- Confirm that Grounded response only is enabled if responses should be limited to available knowledge.
The AI Agent Cannot Answer Questions That Exist in Libraries
If the AI Agent cannot answer questions that are covered by existing knowledge:
- Verify that the correct Libraries are linked to the AI Agent.
- Review the retrieval-related trace details.
- Increase the Number of Chunks, if appropriate.
- Confirm that the required content exists, is published, and is up to date.
- Review the response and trace information to determine whether the AI Agent retrieved the expected knowledge.
Responses Are Missing Relevant Conversation Context
If the AI Agent appears to ignore earlier messages:
- Review the
memory.history.loadtrace stage. - Confirm that conversation history was loaded successfully.
- Review the configured History message limit.
- Check whether the required messages fall outside the loaded history range.
AI Responses Are Slow
If AI-generated responses take longer than expected:
- Review the overall trace Duration.
- Review execution times for each trace stage.
- Identify whether delays occur during
agent.invoke, tool execution, or knowledge retrieval. - Review linked tools, MCP Servers, API Actions, and model settings that may increase execution time.
Fallback Responses Occur More Frequently Than Expected
If the AI Agent frequently returns fallback responses:
- Review the conversation and trace details to determine why a response could not be generated.
- Verify that the required knowledge is available in linked Libraries.
- Review AI Tool configuration and tool availability.
- Review the configured Fallback Instruction.
- Check for tool failures, retrieval failures, or instruction conflicts in the trace data.
Frequently Asked Questions
-
Where can I view AI 2.0 Agent conversations?
Go to AI Center > AI Agents, open More options for the required AI 2.0 Agent, and select View Conversations. -
Can I review AI execution details for a response?
Yes. Click the Traces icon below the applicable AI-generated response. -
What information is available in AI Traces?
AI Traces can display the execution status, Session ID, Message ID, duration, start and end times, Agent ID, and individual execution stages. -
What do the trace-stage durations represent?
Each duration indicates how long the corresponding execution stage took. For example,agent.invokeshows the time spent processing the request and generating the response. -
How do I apply improvements identified from a conversation?
Update an editable draft, test the changes in Playground, publish the updated version, verify its channel mapping, and monitor new conversations.