Share
))
HBO and The Ringer's Bill Simmons hosts the most downloaded sports podcast of all time, with a rotating crew of celebrities, athletes, and media staples, as well as mainstays like Cousin Sal, Joe House, and a slew of other friends and family members who always happen to be suspiciously available.
…
continue reading
Manage episode 509238818 series 3605659
Content provided by Kabir. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Kabir or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.
This episode primarily discusses the evaluation and performance of large language models (LLMs) in complex software engineering tasks, specifically focusing on long-context capabilities. One source, an excerpt from Simon Willison’s Weblog, praises the new Claude Sonnet 4.5 model for its superior performance in code generation, detailing an impressive complex SQLite database refactoring task it successfully completed using its Code Interpreter feature. The second source, an abstract and excerpts from the LoCoBench academic paper, introduces a new, comprehensive benchmark designed to test long-context LLMs up to 1 million tokens across eight specialized software development task categories and 10 programming languages, arguing that existing benchmarks are inadequate for realistic, large-scale code systems. This paper reveals that while models like Gemini-2.5-Pro may lead overall, different models, such as GPT-5, show specialized strengths in areas like Architectural Understanding. Finally, a Reddit post further contributes to the practical discussion by sharing real-world testing results comparing Claude Sonnet 4 and Gemini 2.5 Pro on a large Rust codebase.
Podcast:
https://kabir.buzzsprout.com
YouTube:
https://www.youtube.com/@kabirtechdives
Please subscribe and share.
322 episodes
