Share
AI and digital expert Suchi Srinivasan and fintech practice leader Kamila Rakhimova from Boston Consulting Group (BCG) talk to the women at the vanguard of business, digital, and technology. They’re digging into how these powerhouse leaders got where they are—everything from the joy of projects gone right to the realities of family responsibilities. And crucially, asking: what was that moment you knew you weren't merely getting there...you had arrived? That's when you know you're in your ele ...
…
continue reading
Manage episode 512576138 series 3470198
Content provided by Everyday AI. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Everyday AI or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.
How can you measure ROI on GenAI for your team? 🤔
Internal evaluations and intentionality.
We've helped thousands of orgs put LLMs to work and ACTUALLY save time. On today's show, we're dishing the 7 steps you need to follow.
What’s the best LLM for your team? 7 Steps to evaluate and create ROI for AI -- An Everyday AI chat with Jordan Wilson
Newsletter: Sign up for our free daily newsletter
More on this Episode: Episode Page
Join the discussion on LinkedIn: Thoughts on this? Join the convo on LinkedIn and connect with other AI leaders.
Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineup
Website: YourEverydayAI.com
Email The Show: [email protected]
Connect with Jordan on LinkedIn
Topics Covered in This Episode:
- Choosing the Right Large Language Model
- Evaluating LLMs for Business ROI
- Front-End AI Operating Systems Explained
- Common Traps in AI Model Evaluation
- Public Benchmarks for LLM Evaluation
- Seven-Step LLM Evaluation Framework
- Measuring Pre-GenAI Human Baselines
- Building Realistic AI Test Datasets
- Calculating ROI for GenAI Implementation
- Monthly Retesting and AI Model Updates
Timestamps:
00:00 Choosing the Right AI Model
07:02 Adapting Workflows for AI Integration
10:58 "Gemini's Versatile Modes Overview"
14:30 Avoiding AI Shiny Object Syndrome
15:36 AI Evaluation for Reliability and Improvement
20:36 "Data Testing Guide Essentials"
25:15 Realistic and Messy Data Essentials
26:06 "Building Effective AI Workspaces"
31:08 AI Evaluation and ROI Calculation
34:11 Human Oversight in AI Testing
35:52 Evaluating GenAI Use Cases
39:00 "NotebookLM: AI-Powered Idea Organizer"
Keywords:
Large Language Model, LLM, generative AI, AI operating system, front end AI models, AI evaluation, model ROI, model evaluation steps, AI benchmarks, scientific benchmarks, API connection, enterprise AI, ChatGPT, Claude, Gemini, Copilot, team AI adoption, knowledge worker AI, operating system choice, productivity modes, connectors, deep research mode, agent mode, image generation, web search, Canvas mode, advanced voice mode, business process automation, workflow evaluation, change management, AI training,
Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info)
Make NotebookLM your personal expert. Try it at notebooklm.google.com
Make NotebookLM your personal expert. Try it at notebooklm.google.com
628 episodes
))
