Manage episode 493524390 series 3617425
The Internet of Agents is rapidly taking shape, necessitating innovative foundational standards, protocols, and evaluation methods for its success.
Recorded at Cisco's office in San Jose, we welcome Giovanna Carofiglio, Distinguished Engineer and Senior Director at Outshift by Cisco. As a leader of the AGNTCY Collective (an open-source initiative by Cisco, Galileo, LangChain, and many other participating companies), Giovanna outlines the vision for agents to collaborate seamlessly across the enterprise and the internet. She details the collective's pillars, from agent discovery and deployment using new agentic protocols like Slim, to ensuring a secure, low-latency communication transport layer. This groundbreaking work aims to make distributed agentic communication a reality.
The conversation then explores the critical role of observability and evaluation in building trustworthy agent applications, including defining an interoperable standard schema for communications. Giovanna highlights the complex challenges of scaling agents to thousands or millions, emphasizing the need for robust security (agent identity with OSF schema) and predictable agent behavior through extensive testing and characterization. She distinguishes between protocols like MCP (agent-to-tool) and A2A (agent-to-agent), advocating for open standards and underlying transport layers akin to TCP.
Chapters:
00:00 Introduction
01:00 Overview of Agent Interoperability
02:20 What is AGNTCY
03:45 Agent Discovery and Composition
04:38 Agent Protocols and Communication
05:45 Observability and Evaluation
07:00 Metrics and Standards for Agents
09:45 Challenges in Agent Evaluation
14:15 Low Latency and Active Evaluation
23:34 Synthetic Data and Ground Truth
25:07 Interoperable Agent Schema
26:37 MCP & A2A
30:17 Future of Agent Communication
32:03 Security and Agent Identity
34:37 Collaboration and Community Involvement
38:28 Conclusion
Follow the hosts
Follow Atin
Follow Conor
Follow Vikram
Follow Yash
Follow Today's Guest(s)
AGNTCY Collective: agntcy.org
Connect with Giovanna on LinkedIn
Learn more about Outshift: outshift.cisco.com
Check out Galileo
32 episodes