Chatbots have developed exponentially with developments in synthetic intelligence (AI). Now, with the onset of AI brokers, they’ve grow to be able to dealing with extra advanced and layered interactions, far past conventional conversational limits. In our earlier article on Constructing Multi-Agent Chatbots with AutoGen, we explored the idea of sequential chat utilizing AutoGen, which permits structured, turn-based communication amongst a number of brokers. Now, constructing upon that basis, we’ll flip to a extra advanced characteristic: nested chat. With AutoGen’s sturdy framework, nested conversations allow bots to take care of fluid exchanges as a substitute of following a hard and fast sequence. They will delve into different instruments, deal with interruptions, and resume easily, all inside a single dialog circulate. This text will information you thru implementing nested chat in AutoGen and spotlight its relevance in creating responsive, dynamic agentic interactions.
What’s Nested Chat?
Let’s start by understanding what a nested chat is.
Contemplate a three-agent chat the place it’s required for 2 brokers to repeatedly speak to one another in a loop. This chat between two brokers may be added in a nested chat. As soon as this separate dialog is completed, the agent can deliver again the context to the primary dialog.
The under determine exhibits the conversion circulate of a nested chat.
When the incoming message triggers a situation, that message goes to the nested chat. That nested could be a two-agent chat, a sequential chat, or some other. Then the chat outcomes of the nested chat are despatched again to the primary dialog.
Implementing Nested Chat in AutoGen
On this article, we’ll construct an article-writing system utilizing a nested chat. For this, we’ll create three brokers – one for writing an overview of the article, one other for writing the article based mostly on this define, and one other for reviewing the article. We’ll need the author and reviewer to speak to one another a number of instances so we’ll these two in a nested chat.
Moreover, we may also present the define agent entry to a software to question the net.
Now, let’s implement this with code.
Pre-requisites
Earlier than constructing AutoGen brokers, guarantee you’ve gotten the required API keys for the required LLMs. For this train, we may also be utilizing Tavily to go looking the net.
Load the .env file with the API keys wanted. Right here we’ll use OpenAI and Tavily API keys ().
from dotenv import load_dotenv
load_dotenv('/residence/santhosh/Initiatives/programs/Pinnacle/.env')Outline the LLM for use as a config_list
config_list = {
"config_list": [{"model": "gpt-4o-mini", "temperature": 0.2}]
}Key Libraries Required
autogen-agentchat – 0.2.37
Tavily-python – 0.5.0
Now, let’s get to the implementation.
Step 1: Outline the Define Agent with the Instrument Use
Outline the user_proxy agent which may also execute the software. Then outline the Define Agent utilizing the LLM to generate the article define.
from autogen import ConversableAgent
user_proxy = ConversableAgent(
identify="Consumer",
llm_config=False,
is_termination_msg=lambda msg: msg.get("content material") will not be None and "TERMINATE" in msg["content"],
human_input_mode="TERMINATE")
define = ConversableAgent(
identify="Article_outline",
system_message="""You might be an skilled content material strategist tasked with creating an in depth define
for an article on a specified subject. Your objective is to arrange the article into
logical sections that assist convey the primary concepts clearly and successfully.
Use the web_search software if wanted.
Return 'TERMINATE' when the duty is completed.""",
llm_config=config_list,
silent=False,
)
Outline the web_search operate to question the net.
def web_search(question: str) -> str:
tavily_client = TavilyClient()
response = tavily_client.search(question, max_results=3, days=10, include_raw_content=True)
return response['results']Register the web_search operate to the define agent with the executor as user_proxy.
We’re making the executor as user_proxy in order that we will evaluate the define that goes to the author agent.
register_function(
web_search,
caller=define, # The assistant agent can counsel calls.
executor=user_proxy, # The person proxy agent can execute the calls.
identify="web_search", # By default, the operate identify is used because the software identify.
description="Searches web to get the outcomes a for given question", # An outline of the software.
)Step 2: Outline the Author and Reviewer Brokers
Outline one agent to generate the article content material, and one other to evaluate the article and supply ideas to enhance.
author = ConversableAgent(
identify="Article_Writer",
system_message="""You're a expert author assigned to create a complete, participating article
based mostly on a given define. Your objective is to comply with the construction supplied within the define,
increasing on every part with well-researched, clear, and informative content material.
Maintain the article size to round 500 phrases.
Use the web_search software if wanted.
Return 'TERMINATE' when the duty is completed.""",
llm_config=config_list,
silent=False,
)
reviewer = ConversableAgent(
identify="Article_Reviewer",
system_message="""You're a expert article reviewer who can evaluate technical articles.
Overview the given article and supply ideas to make the article extra participating and attention-grabbing.
""",
llm_config=config_list,
silent=False,
)
Step 3: Register the Nested Chat
We will now register the nested chats for each brokers.
author.register_nested_chats(
set off=user_proxy,
chat_queue=[
{
"sender": reviewer,
"recipient": writer,
"summary_method": "last_msg",
"max_turns": 2,
}
],
)Within the above code, when user_proxy sends any message to the author agent, this may set off the nested chat. Then the author agent will write the article and the reviewer agent will evaluate the article as many instances as max_turns, two on this case. Lastly, the results of the nested chat is distributed again to the person agent.
Step 4: Provoke the Nested Chat
Now that all the pieces is ready, let’s provoke the chat
chat_results = user_proxy.initiate_chats(
[{"recipient": outline,
"message": "Write an article on Magentic-One agentic system released by Microsoft.",
"summary_method": "last_msg",
},
{"recipient": writer,
"message": "This is the article outline",
"summary_method": "last_msg",
}])Right here, we’re going to write an article concerning the Magentic-One agentic system. First, the user_proxy agent will provoke a chat with the Define Agent, after which with the Author Agent.
Now, the output of the above code might be like this:
As we will see, the user_proxy first sends a message stating the subject of the article to the Define Agent. This triggers the software name and user_proxy executes the software. Based mostly on these outcomes, the Define Agent will generate the define and ship it to the author agent. After that, the nested chat between the author agent and reviewer agent continues as mentioned above.
Now, let’s print the ultimate end result, which is the article about magentic-one.
print(chat_results[1].chat_history[-2]['content'])
Conclusion
Nested chat in AutoGen enhances chatbot capabilities by enabling advanced, multitasking interactions inside a single dialog circulate. Nested chat permits bots to provoke separate, specialised chats and combine their outputs seamlessly. This characteristic helps dynamic, focused responses throughout numerous purposes, from e-commerce to healthcare. With nested chat, AutoGen paves the way in which for extra responsive, context-aware AI techniques. This allows builders to construct refined chatbots that meet various person wants effectively.
If you wish to be taught extra about AI Brokers, checkout our unique Agentic AI Pioneer Program!
Often Requested Questions
A. Nested chat in AutoGen permits a chatbot to handle a number of sub-conversations inside a single chat circulate, typically involving different brokers or instruments to retrieve particular info. In contrast to sequential chat, which follows a structured, turn-based strategy, nested chat allows bots to deal with interruptions and parallel duties, integrating their outputs again into the primary dialog.
A. Nested chat improves buyer help by permitting bots to delegate duties to specialised brokers. As an illustration, in e-commerce, a chatbot can seek the advice of a separate agent to examine order standing or product info, then seamlessly relay the data again to the person, guaranteeing faster, extra correct responses.
A. Nested chat may be utilized in various industries. In banking, it offers specialised help for account and mortgage queries; in HR, it assists with onboarding duties; and in healthcare, it handles appointment scheduling and billing inquiries. This flexibility makes nested chat appropriate for any area requiring multitasking and detailed info dealing with.
A. Sure, implementing nested chat in AutoGen requires configuring brokers with particular API keys, resembling for language fashions or internet search instruments like Tavily. Moreover, every agent should be outlined with acceptable duties and instruments for the sleek execution of nested conversations.
A. Sure, AutoGen permits monitoring the fee incurred by every agent in a nested chat. By accessing the `value` attribute in chat outcomes, builders can monitor bills associated to agent interactions, serving to optimize the chatbot’s useful resource utilization and effectivity.
I’m working as an Affiliate Information Scientist at Analytics Vidhya, a platform devoted to constructing the Information Science ecosystem. My pursuits lie within the fields of Pure Language Processing (NLP), Deep Studying, and AI Brokers.