))
Raza Habib: Humanloop, LLM and Prompting, Gen AI Performace - AI Portfolio Podcast
Manage episode 460527788 series 3596668
Content provided by Mark Moyou, PhD and Mark Moyou. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Mark Moyou, PhD and Mark Moyou or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.
Dr. Raza Habib, CEO of HumanLoop, discussing the complexities of large language model (LLM) deployment, monitoring, and evaluation.
Follow/Connect:
Raza Linkedin: https://www.linkedin.com/in/humanloop-raza/
Mark LinkedIn: https://www.linkedin.com/in/markmoyou/
Chapters:
00:00 Intro
02:19 Humanloop
06:08 Prompt Management
13:26 LLM System
17:57 AI Guardrails
22:32 Workflow
27:14 User Generated Hyperparameters
31:30 LLM Routing
34:20 Prompt Engineering
38:22 Data Poisoning
45:17 Latency in LLMs
50:25 Monitoring LLMs
57:57 LLM Eval Benchmarks
01:03:27 Startup
01:17:51 Career Optimization Function
01:19:44 Books
01:24:27 Career Advice
01:27:51 Rapid Round
22 episodes
Share
