Welcome to The MLSecOps Podcast, presented by Protect AI. Here we explore the world of machine learning security operations, a.k.a., MLSecOps. From preventing attacks to navigating new AI regulations, we'll dive into the latest developments, strategies, and best practices with industry leaders and AI experts. Sit back, relax, and learn something new with us today. Learn more and get involved with the MLSecOps Community at https://bit.ly/MLSecOps.
…
continue reading
Llm Deployment Strategies Podcasts
"Last Week In r/LocalLLaMA" is your weekly roundup of the most interesting discussions, debates, and moments from the r/LocalLLaMA community. Join us for a fun and lighthearted take on the top posts, user opinions, and trending topics. Perfect for keeping up with the conversation, even when you’re short on time.
…
continue reading
Interviews with developers and API technology leaders. Hosted by Sagar Batchu, CEO of Speakeasy. speakeasy.com
…
continue reading

1
AI Agent Security: Threats & Defenses for Modern Deployments
31:39
31:39
Play later
Play later
Lists
Like
Liked
31:39Send us a text Researchers Yifeng (Ethan) He and Peter Rong join host Madi Vorbrich to break down their paper "Security of AI Agents." They explore real-world AI agent threats, like session hijacks and tool-based jailbreaks, and share practical defenses, from sandboxing to agent-to-agent protocols. Full transcript with links to resources available …
…
continue reading

1
Overcoming barriers to mobile dev, smoothing DevEx, and AI-driven coding shifts | Charlie Cheever (CEO, Expo)
17:41
17:41
Play later
Play later
Lists
Like
Liked
17:41In this episode of Request // Response, I sit down with Charlie Cheever, CEO of Expo and co-founder of Quora, to unpack the evolution of mobile app development and how developer experience is adapting in an AI-assisted world. Charlie shares stories from scaling Quora's mobile presence, his frustrations with App Store complexity, and how Expo is aim…
…
continue reading
Send us a text Part 2 with Gavin Klondike dives into autonomous AI agents—how they really work, the attack paths they open, and practical defenses like least-privilege APIs and out-of-band auth. A must-listen roadmap for anyone building—or defending—the next generation of AI applications. Full transcript with links to resources available at https:/…
…
continue reading

1
Beyond Prompt Injection: AI’s Real Security Gaps
26:02
26:02
Play later
Play later
Lists
Like
Liked
26:02Send us a text In Part 1 of this two-part MLSecOps Podcast, Principal Security Consultant Gavin Klondike joins Dan and Marcello to break down the real threats facing AI systems today. From prompt injection misconceptions to indirect exfiltration via markdown and the failures of ML Ops security practices, Gavin unpacks what the industry gets wrong—a…
…
continue reading

1
Multimodal automation, API democratization, and the evolution of tool calling | Sinan Eren (CEO & co-founder Opnova)
16:55
16:55
Play later
Play later
Lists
Like
Liked
16:55I sat down with Sinan Eren, co-founder and CEO of Opnova. Opnova is building AI-powered automation for enterprises—specifically targeting companies that rely on legacy systems and lack modern APIs. We talked about how automation can thrive even in systems that don't have APIs and discussed the challenges and opportunities of automating workflows in…
…
continue reading

1
What’s Hot in AI Security at RSA Conference 2025?
24:14
24:14
Play later
Play later
Lists
Like
Liked
24:14Send us a text What’s really hot at RSA Conference 2025? MLSecOps Community Manager Madi Vorbrich sits down with Protect AI Co‑Founder Daryan “D” Dehghanpisheh for a rapid rundown of must‑see sessions, booth events, and emerging AI‑security trends—from GenAI agents to zero‑trust AI and million‑model scans. Use this episode to build a bullet‑proof R…
…
continue reading

1
Unpacking the Cloud Security Alliance AI Controls Matrix
35:53
35:53
Play later
Play later
Lists
Like
Liked
35:53Send us a text In this episode of the MLSecOps Podcast, we sit down with three expert contributors from the Cloud Security Alliance’s AI Controls Matrix working group. They reveal how this newly released framework addresses emerging AI threats—like model poisoning and adversarial manipulation—through robust technical controls, detailed implementati…
…
continue reading

1
Anthropic MCP, GraphQL vs REST, and API strategies for LLM dev tools | Ken Rose (CTO & co-founder OpsLevel)
28:10
28:10
Play later
Play later
Lists
Like
Liked
28:10Ken Rose is the CTO and co-founder of OpsLevel. Ken shares the founding journey of OpsLevel and lessons from his time at PagerDuty and Shopify. We debate GraphQL vs REST, API metrics that matter, and how LLMs and agentic workflows could reshape developer productivity. Listen On Apple Podcasts | Spotify Subscribe to Request // Response If you enjoye…
…
continue reading

1
From Pickle Files to Polyglots: Hidden Risks in AI Supply Chains
41:21
41:21
Play later
Play later
Lists
Like
Liked
41:21Send us a text Join Keith Hoodlet from Trail of Bits as he dives into AI/ML security, discussing everything from prompt injection and fuzzing techniques to bias testing and compliance challenges. Full transcript with links to resources available at https://mlsecops.com/podcast/from-pickle-files-to-polyglots-hidden-risks-in-ai-supply-chains Thanks f…
…
continue reading

1
Rethinking AI Red Teaming: Lessons in Zero Trust and Model Protection
36:52
36:52
Play later
Play later
Lists
Like
Liked
36:52Send us a text Full transcript with links to resources available at https://mlsecops.com/podcast/rethinking-ai-red-teaming-lessons-in-zero-trust-and-model-protection This episode is a follow up to Part 1 of our conversation with returning guest Brian Pendleton, as he challenges the way we think about red teaming and security for AI. Continuing from…
…
continue reading

1
API design ergonomics, coding on airplanes, and the true signal of good DevEx | Robert Ross (CEO FireHydrant)
26:07
26:07
Play later
Play later
Lists
Like
Liked
26:07Robert Ross (@BobbyTables) is the CEO of FireHydrant. We discuss the journey of building FireHydrant, the evolution of API design, and the impact of gRPC and REST on developer experience. We also talked about the role of LLMs in API design, the shift towards data consumption trends in enterprises, and how great developer experience is measured by a…
…
continue reading

1
AI Security: Map It, Manage It, Master It
41:18
41:18
Play later
Play later
Lists
Like
Liked
41:18Send us a text Full transcript with links to resources available at https://mlsecops.com/podcast/ai-security-map-it-manage-it-master-it In part one of our two-part MLSecOps Podcast episode, security veteran Brian Pendleton takes us from his early hacker days to the forefront of AI security. Brian explains why mapping every AI integration is essenti…
…
continue reading

1
Separating deployment from release, API-first development, and the future of developer experience | John Kodumal (co-founder & fmr CTO LaunchDarkly)
26:04
26:04
Play later
Play later
Lists
Like
Liked
26:04On the first episode of Request // Response, I speak with John Kodumal, co-founder and former CTO of LaunchDarkly. We discussed how LaunchDarkly used feature flags to separate deployment from release, offering fine-grained control for safer rollouts and experimentation. LaunchDarkly was an early adopter of server-sent events, and was a pioneer of t…
…
continue reading

1
Agentic AI: Tackling Data, Security, and Compliance Risks
23:22
23:22
Play later
Play later
Lists
Like
Liked
23:22Send us a text Full transcript with links to resources available at https://mlsecops.com/podcast/agentic-ai-tackling-data-security-and-compliance-risks Join host Diana Kelley and CTO Dr. Gina Guillaume-Joseph as they explore how agentic AI, robust data practices, and zero trust principles drive secure, real-time video analytics at Camio. They discu…
…
continue reading

1
AI Vulnerabilities: ML Supply Chains to LLM and Agent Exploits
24:08
24:08
Play later
Play later
Lists
Like
Liked
24:08Send us a text Full transcript with links to resources available at https://mlsecops.com/podcast/ai-vulnerabilities-ml-supply-chains-to-llm-and-agent-exploits Join host Dan McInerney and AI security expert Sierra Haex as they explore the evolving challenges of AI security. They discuss vulnerabilities in ML supply chains, the risks in tools like Ra…
…
continue reading

1
Implementing Enterprise AI Governance: Balancing Ethics, Innovation & Risk for Business Success
38:39
38:39
Play later
Play later
Lists
Like
Liked
38:39Send us a text Full transcript with links to resources available at https://mlsecops.com/podcast/implementing-a-robust-ai-governance-framework-for-business-success In this episode of the MLSecOps podcast, host Charlie McCarthy sits down with Chris McClean, Global Lead for Digital Ethics at Avanade, to explore the world of responsible AI governance.…
…
continue reading

1
Unpacking Generative AI Red Teaming and Practical Security Solutions
51:53
51:53
Play later
Play later
Lists
Like
Liked
51:53Send us a text Full transcript with links to resources available at https://mlsecops.com/podcast/unpacking-generative-ai-red-teaming-and-practical-security-solutions In this episode, we explore LLM red teaming beyond simple “jailbreak” prompts with special guest Donato Capitella, from WithSecure Consulting. You’ll learn why vulnerabilities live in …
…
continue reading

1
AI Security: Vulnerability Detection and Hidden Model File Risks
38:19
38:19
Play later
Play later
Lists
Like
Liked
38:19Send us a text In this episode of the MLSecOps Podcast, the team dives into the transformative potential of Vulnhuntr: zero shot vulnerability discovery using LLMs. Madison Vorbrich hosts Dan McInerney and Marcello Salvati to discuss Vulnhuntr’s ability to autonomously identify vulnerabilities, including zero-days, using large language models (LLMs…
…
continue reading

1
AI Governance Essentials: Empowering Procurement Teams to Navigate AI Risk
37:41
37:41
Play later
Play later
Lists
Like
Liked
37:41Send us a text Full transcript with links to resources available at https://mlsecops.com/podcast/ai-governance-essentials-empowering-procurement-teams-to-navigate-ai-risk. In this episode of the MLSecOps Podcast, Charlie McCarthy from Protect AI sits down with Dr. Cari Miller to discuss the evolving landscapes of AI procurement and governance. Dr. …
…
continue reading

1
Crossroads: AI, Cybersecurity, and How to Prepare for What's Next
33:15
33:15
Play later
Play later
Lists
Like
Liked
33:15Send us a text In this episode of the MLSecOps Podcast, Distinguished Engineer Nicole Nichols from Palo Alto Networks joins host and Machine Learning Scientist Mehrin Kiani to explore critical challenges in AI and cybersecurity. Nicole shares her unique journey from mechanical engineering to AI security, her thoughts on the importance of clear AI v…
…
continue reading
Last Week In r_LocalLLaMA | October 18 00:00 Introduction to Local AI 00:39 Epic Hardware Setups 01:26 Mistral's New Model Controversy 02:42 OpenAI Whisperer Turbo Excitement 04:04 Supernova Media System Discussion 04:50 Benchmark Drama and MMLU Scores 05:55 Buzz Around F5TTS Model 06:16 Community Contributions and Model Improvements 06:37 Nemetron…
…
continue reading

1
Machines of Loving Grace: Dario Amodei's Vision for a Better World with AI
1:25:09
1:25:09
Play later
Play later
Lists
Like
Liked
1:25:09I recently started reading Dario Amodei's essay, 'Machines of Loving Grace: How AI Could Transform the World for the Better,' and found it incredibly insightful but quite lengthy. To make it more digestible and something that I can take during my walks, I converted it into an audio narrated version using ElevenLabs. If you'd prefer to listen rather…
…
continue reading

1
Last Week's r/LocalLLaMA Recap | Sep 27 - Oct 3
20:49
20:49
Play later
Play later
Lists
Like
Liked
20:49Unlock the future of AI with our weekly deep dive into r/LocalLLaMA. From OpenAI's lightning-fast Whisper to Meta's rumored million-GPU infrastructure, we explore the cutting-edge developments shaping the AI landscape. Join us for an insightful journey through the latest breakthroughs, community debates, and technological innovations in local AI. C…
…
continue reading

1
AI Beyond the Hype: Lessons from Cloud on Risk and Security
41:06
41:06
Play later
Play later
Lists
Like
Liked
41:06Send us a text On this episode of the MLSecOps Podcast, we’re bringing together two cybersecurity legends. Our guest is the inimitable Caleb Sima, who joins us to discuss security considerations for building and using AI, drawing on his 25+ years of cybersecurity experience. Caleb's impressive journey includes co-founding two security startups acqu…
…
continue reading

1
Generative AI Prompt Hacking and Its Impact on AI Security & Safety
31:59
31:59
Play later
Play later
Lists
Like
Liked
31:59Send us a text Welcome to Season 3 of the MLSecOps Podcast, brought to you by Protect AI! In this episode, MLSecOps Community Manager Charlie McCarthy speaks with Sander Schulhoff, co-founder and CEO of Learn Prompting. Sander discusses his background in AI research, focusing on the rise of prompt engineering and its critical role in generative AI.…
…
continue reading
Send us a text This compilation contains highlights from episodes throughout Season 2 of the MLSecOps Podcast, and it's a great one for community members who are new to the show. If there is a clip from this highlights reel that is especially interesting to you, you can note the name of the original episode that the clip came from and easily go che…
…
continue reading

1
Exploring Generative AI Risk Assessment and Regulatory Compliance
37:37
37:37
Play later
Play later
Lists
Like
Liked
37:37Send us a text In this episode of the MLSecOps Podcast we have the honor of talking with David Rosenthal, Partner at VISCHER (Swiss Law, Tax & Compliance). David is also an author & former software developer, and lectures at ETH Zürich & the University of Basel. He has more than 25 years of experience in data & technology law and kindly joined the …
…
continue reading

1
MLSecOps Culture: Considerations for AI Development and Security Teams
38:44
38:44
Play later
Play later
Lists
Like
Liked
38:44Send us a text In this episode, we had the pleasure of welcoming Co-Founder and CISO of Weights & Biases, Chris Van Pelt, to the MLSecOps Podcast. Chris discusses a range of topics with hosts Badar Ahmed and Diana Kelley, including the history of how W&B was formed, building a culture of security & knowledge sharing across teams in an organization,…
…
continue reading

1
Practical Offensive and Adversarial ML for Red Teams
35:24
35:24
Play later
Play later
Lists
Like
Liked
35:24Send us a text Next on the MLSecOps Podcast, we have the honor of highlighting one of our MLSecOps Community members and Dropbox™ Red Teamers, Adrian Wood. Adrian joined Protect AI threat researchers, Dan McInerney and Marcello Salvati, in the studio to share an array of insights, including what inspired him to create the Offensive ML (aka OffSec M…
…
continue reading

1
Expert Talk from RSA Conference: Securing Generative AI
25:42
25:42
Play later
Play later
Lists
Like
Liked
25:42Send us a text In this episode, host Neal Swaelens (EMEA Director of Business Development, Protect AI) catches up with Ken Huang, CISSP at RSAC 2024 to talk about security for generative AI. Thanks for checking out the MLSecOps Podcast! Get involved with the MLSecOps Community and find more resources at https://community.mlsecops.com. Additional to…
…
continue reading
Send us a text In this episode of the MLSecOps Podcast, we delve into the critical world of security for AI and machine learning with our guest Ron F. Del Rosario, Chief Security Architect and AI/ML Security Lead at SAP ISBN. The discussion highlights the contextual knowledge gap between ML practitioners and cybersecurity professionals, emphasizing…
…
continue reading

1
Evaluating RAG and the Future of LLM Security: Insights with LlamaIndex
31:04
31:04
Play later
Play later
Lists
Like
Liked
31:04Send us a text In this episode of the MLSecOps Podcast, host Neal Swaelens, along with co-host Oleksandr Yaremchuk, sit down with special guest Simon Suo, co-founder and CTO of LlamaIndex. Simon shares insights into the development of LlamaIndex, a leading data framework for orchestrating data in large language models (LLMs). Drawing from his backg…
…
continue reading

1
AI Threat Research: Spotlight on the Huntr Community
31:48
31:48
Play later
Play later
Lists
Like
Liked
31:48Send us a text Learn about the world’s first bug bounty platform for AI & machine learning, huntr, including how to get involved! This week’s featured guests are leaders from the huntr community (brought to you by Protect AI): Dan McInerney, Lead AI Threat Researcher Marcello Salvati, Sr. Engineer & Researcher Madison Vorbrich, Community Manager Th…
…
continue reading

1
Securing AI: The Role of People, Processes & Tools in MLSecOps
37:16
37:16
Play later
Play later
Lists
Like
Liked
37:16Send us a text In this episode of The MLSecOps Podcast hosted by Daryan Dehghanpisheh (Protect AI) and special guest-host Martin Stanley, CISSP (Cybersecurity and Infrastructure Security Agency), we delve into critical aspects of AI security and operations. This episode features esteemed guests, Gary Givental (IBM) and Kaleb Walton (FICO). The grou…
…
continue reading

1
ReDoS Vulnerability Reports: Security Relevance vs. Noisy Nuisance
35:30
35:30
Play later
Play later
Lists
Like
Liked
35:30Send us a text In this episode, we delve into a hot topic in the bug bounty world: ReDoS (Regular Expression Denial of Service) reports. Inspired by reports submitted by the huntr AI/ML bug bounty community and an insightful blog piece by open source expert, William Woodruff (Engineering Director, Trail of Bits), this conversation explores: Are any…
…
continue reading

1
Finding a Balance: LLMs, Innovation, and Security
41:56
41:56
Play later
Play later
Lists
Like
Liked
41:56Send us a text In this episode of The MLSecOps Podcast, special guest, Sandy Dunn, joins us to discuss the dynamic world of large language models (LLMs) and the equilibrium of innovation and security. Co-hosts, Daryan “D” Dehghanpisheh and Dan McInerney talk with Sandy about the nuanced challenges organizations face in managing LLMs while mitigatin…
…
continue reading
Send us a text In this episode of The MLSecOps Podcast, Nick James, CEO of WhitegloveAI dives in with show host, Chris King, Head of Product at Protect AI, to offer enlightening insights surrounding: - AI Governance - ISO - International Organization for Standardization ISO/IEC 42001:2023-Information Technology, Artificial Intelligence Management S…
…
continue reading

1
Risk Management and Enhanced Security Practices for AI Systems
38:08
38:08
Play later
Play later
Lists
Like
Liked
38:08Send us a text In this episode of The MLSecOps Podcast, VP Security and Field CISO of Databricks, Omar Khawaja, joins the CISO of Protect AI, Diana Kelley. Together, Diana and Omar discuss a new framework for understanding AI risks, fostering a security-minded culture around AI, building the MLSecOps dream team, and some of the challenges that Chie…
…
continue reading

1
Evaluating Real-World Adversarial ML Attack Risks and Effective Management: Robustness vs Non-ML Mitigations
41:19
41:19
Play later
Play later
Lists
Like
Liked
41:19Send us a text In this episode, co-hosts Badar Ahmed and Daryan Dehghanpisheh are joined by Drew Farris (Principal, Booz Allen Hamilton) and Edward Raff (Chief Scientist, Booz Allen Hamilton) to discuss themes from their paper, "You Don't Need Robust Machine Learning to Manage Adversarial Attack Risks," co-authored with Michael Benaroch. Thanks for…
…
continue reading

1
From Risk to Responsibility: Violet Teaming in AI; With Guest: Alexander Titus
43:20
43:20
Play later
Play later
Lists
Like
Liked
43:20Send us a text In this episode, the founder and CEO of The In Vivo Group, Alexander Titus, joins show hosts Diana Kelley and Daryan Dehghanpisheh to discuss themes from his forward-thinking paper, "The Promise and Peril of Artificial Intelligence -- Violet Teaming Offers a Balanced Path Forward," authored with Adam H. Russell. Thanks for checking o…
…
continue reading

1
Cybersecurity of Tomorrow: Exploring the Future of Security and Governance for AI Systems; With Guest: Martin Stanley, CISSP
39:45
39:45
Play later
Play later
Lists
Like
Liked
39:45Send us a text *This episode is also available in video format! Click to watch the full YouTube video.* Welcome to Season 2 of The MLSecOps Podcast! In this episode, we joined Strategic Technology Branch Chief, Martin Stanley, CISSP, from the Cybersecurity and Infrastructure Security Agency (CISA), to celebrate 20 years of Cybersecurity Awareness M…
…
continue reading

1
AI/ML Security in Retrospect: Insights from Season 1 of The MLSecOps Podcast (Part 2)
42:28
42:28
Play later
Play later
Lists
Like
Liked
42:28Send us a text *This episode is also available in video format! Click to watch the full YouTube video.* Welcome back, everyone, to The MLSecOps Podcast. We’re thrilled to have you with us for Part 2 of our two-part season finale, as we wrap up Season 1 and look forward to an exciting and revamped Season 2. In this two-part season recap, we’ve been …
…
continue reading

1
AI/ML Security in Retrospect: Insights from Season 1 of The MLSecOps Podcast (Part 1)
37:10
37:10
Play later
Play later
Lists
Like
Liked
37:10Send us a text *This episode is also available in video format! Click to watch the full YouTube video.* Welcome to the final episode of the first season of The MLSecOps Podcast, brought to you by the team at Protect AI. In this two-part episode, we’ll be taking a look back at some favorite highlights from the season where we dove deep into machine …
…
continue reading

1
A Holistic Approach to Understanding the AI Lifecycle and Securing ML Systems: Protecting AI Through People, Processes & Technology; With Guest: Rob van der Veer
29:25
29:25
Play later
Play later
Lists
Like
Liked
29:25Send us a text Joining us for the first time as a guest host is Protect AI’s CEO and founder, Ian Swanson. Ian is joined this week by Rob van der Veer, a pioneer in AI and security. Rob gave a presentation at Global AppSec Dublin earlier this year called “Attacking and Protecting Artificial Intelligence” which was a large inspiration for this episo…
…
continue reading

1
ML Model Fairness: Measuring and Mitigating Algorithmic Disparities; With Guest: Nick Schmidt
35:33
35:33
Play later
Play later
Lists
Like
Liked
35:33Send us a text This week we’re talking about the role of fairness in AI/ML. It is becoming increasingly apparent that incorporating fairness into our AI systems and machine learning models while mitigating bias and potential harms is a critical challenge. Not only that, it’s a challenge that demands a collective effort to ensure the responsible, se…
…
continue reading

1
Exploring AI/ML Security Risks: At Black Hat USA 2023 with Protect AI
35:20
35:20
Play later
Play later
Lists
Like
Liked
35:20Send us a text Watch the video for this episode at: https://mlsecops.com/podcast/exploring-ai/ml-security-risks-at-black-hat-usa-2023 This episode of The MLSecOps Podcast features expert security leaders who sat down at Black Hat USA 2023 last week with team members from Protect AI to talk about various facets of AI and machine learning security: -…
…
continue reading

1
Everything You Need to Know About Hacker Summer Camp 2023
38:59
38:59
Play later
Play later
Lists
Like
Liked
38:59Send us a text Welcome back to The MLSecOps Podcast for this week's episode, “Everything You Need to Know About Hacker Summer Camp 2023.” This week, our show is hosted by Protect AI's Chief Information Security Officer, Diana Kelley, and Diana talks with two more longtime security experts, Chloé Messdaghi and Dan McInerney, about all things related…
…
continue reading

1
Privacy Engineering: Safeguarding AI & ML Systems in a Data-Driven Era; With Guest Katharine Jarmul
46:44
46:44
Play later
Play later
Lists
Like
Liked
46:44Send us a text Welcome to The MLSecOps Podcast, where we dive deep into the world of machine learning security operations. In this episode, we talk with the renowned Katharine Jarmul. Katharine is a Principal Data Scientist at Thoughtworks, and the author of the popular new book, Practical Data Privacy. Katharine also writes a blog titled, Probably…
…
continue reading

1
The Intersection of MLSecOps and DataPrepOps; With Guest: Jennifer Prendki, PhD
34:40
34:40
Play later
Play later
Lists
Like
Liked
34:40Send us a text On this week’s episode from The MLSecOps Podcast, we have the pleasure of hearing from Dr. Jennifer Prendki, founder and CEO of Alectio - The DataPrepOps Company. Alectio’s name comes from a blend of the acronym “AL,” standing for Active Learning, and the Latin term for the word “selection,” which is “lectio.” In this episode, Dr. Pr…
…
continue reading

1
The Evolved Adversarial ML Landscape; With Guest: Apostol Vassilev, NIST
30:30
30:30
Play later
Play later
Lists
Like
Liked
30:30Send us a text In this episode, we explore the National Institute of Standards and Technology (NIST) white paper, Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations. The report is co-authored by our guest for this conversation; Apostol Vassilev, NIST Research Team Supervisor. Apostol provides insights into the motiv…
…
continue reading