Artwork
iconShare
 
Manage episode 518099454 series 3499431
Content provided by Evan Kirstel. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Evan Kirstel or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.

Interested in being a guest? Email us at [email protected]

AI is moving faster than any wave we’ve seen—and the hidden cost is complexity. We sit down with New Relic’s leadership to unpack how observability must evolve to keep up with agents, vibe coding, and probabilistic systems that don’t fail like traditional software. From the early SaaS days to hyperscale cloud and now AI-native architectures, we connect the dots on where value breaks, why pilots get stuck, and what changes when real users meet real AI in production.
We challenge the headline that “95% of GenAI projects fail” and explain the real blockers: adoption, verification, and integration into messy enterprise workflows. Then we dive into the rise of AI agents—microagents and nanoagents coordinating around-the-clock—to offload repetitive tasks and accelerate delivery. With that power comes a new ops reality: tracing prompts and tool calls, monitoring hallucinations, enforcing safety policies, and tying every hop back to user and business outcomes. You’ll hear practical guardrails for vibe coding, including evaluation suites, prompt versioning, canary releases, role-based access, and real-time model quality monitoring.
Finally, we look at outages through a clear lens: even the smartest teams can’t outpace system complexity without better visibility and faster remediation. New Relic’s two-pronged roadmap—observability for AI and AI for observability—aims to give teams both the data and the decisions: model-aware telemetry, agent state insights, automated incident summaries, and recommended fixes that protect revenue and trust. If you’re planning for 2026, take this as your cue to embrace the era with discipline: ship agents, instrument everything, and let observability become the backbone of safe, scalable AI.
If this conversation helps you think sharper about AI in production, follow the show, share it with your team, and leave a quick review so others can find it.

Support the show

More at https://linktr.ee/EvanKirstel

  continue reading

Chapters

1. Setting The Stage: New Relic And AI (00:00:00)

2. Three Eras Of Observability (00:01:04)

3. Do 95% Of GenAI Projects Fail? (00:02:26)

4. From Experiments To Production Adoption (00:04:04)

5. Rise Of AI Agents In 2025 (00:04:37)

6. Agent Architectures Need Oversight (00:06:02)

7. Guardrails For Vibe Coding And Safety (00:07:18)

8. Outages, Complexity, And Impact (00:09:10)

9. New Relic’s Two-Pronged AI Roadmap (00:11:16)

10. Planning For 2026: Embrace The Era (00:13:12)

554 episodes