Building A Local Large Language Model (LLM) The Machine: A Computer Science Education podcast

Over 20 million podcasts, powered by

Artwork

Building a Local Large Language Model (LLM)

The Machine: A computer science education podcast

0-10 subscribers

published 1+ y ago

Share

M4A•Episode home

Content provided by Rob O'Connor. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Rob O'Connor or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.

Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.

You can connect with all the people on this podcast on LinkedIn at:

Mark Campbell https://www.linkedin.com/in/mark-campbell-76846b194/
Dimitri Saradakis https://www.linkedin.com/in/dimitri-saridakis-32a087139/
Rob O'Connor https://www.linkedin.com/in/robertoconnorirl/

Here are links to some of the tools referenced in the podcast:

Red Hat OpenShift AI https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-ai

… continue reading

62 episodes

#Tech #Rob OConnor

All episodes

×

Top Podcasts

Artwork

1
The Bill Simmons Podcast

The Ringer

176k

1k

3d ago3d ago

Weekly+

HBO and The Ringer's Bill Simmons hosts the most downloaded sports podcast of all time, with a rotating crew of celebrities, athletes, and media staples, as well as mainstays like Cousin Sal, Joe House, and a slew of other friends and family members who always happen to be suspiciously available.

… continue reading

Artwork

1
PTI

ESPN, Tony Kornheiser, Michael Wilbon

146k

200

41m ago41m ago

Daily

Tony Kornheiser and Michael Wilbon face off in the nation's capital on the day's hottest topics.

… continue reading

Artwork

1
First Take

ESPN, Stephen A. Smith, Molly Qerim Rose

12k

200

8h ago8h ago

Daily

First Take is always a heated discussion as Stephen A. Smith and guests debate about the day's top stories.

… continue reading

Artwork

1
Marketplace

Marketplace

435k

50

23h ago23h ago

Daily

Every weekday, host Kai Ryssdal helps you make sense of the day's business and economic news — no econ degree or finance background required. "Marketplace" takes you beyond the numbers, bringing you context. Our team of reporters all over the world speak with CEOs, policymakers and regular people just trying to get by.

… continue reading

Artwork

1
Comedy of the Week

BBC Radio 4

275k

37

4d ago4d ago

Weekly

Brighten your week with the latest BBC Radio 4 comedy.

… continue reading

Artwork

1
The Bugle

The Bugle

227k

659

8d ago1w ago

Weekly

It's the trans-global satiricast that leaves no hot potato unbuttered. Andy Zaltzman breaks down the news with comedians from across the world including Alice Fraser, Hari Kondabolu, Chris Addison, John Oliver, Nish Kumar, Tiff Stevenson and Helen Zaltzman. Go to TheBuglePodcast.com to become a premium subscriber and get exclusive shows. Follow us on YouTube. Hosted on Acast. See acast.com/privacy for more information.

… continue reading

Artwork

1
How Did This Get Made?

Earwolf and Paul Scheer, June Diane Raphael, Jason Mantzoukas

431k

272

2d ago2d ago

Weekly+

The award-winning comedy podcast that celebrates bad movies. Comedians and actors Paul Scheer (The League), June Diane Raphael (Grace and Frankie), and Jason Mantzoukas (Big Mouth) break down the very best of the worst films ever made—we’re talkin’ blockbuster flops, cheesy 80s action movies, Lifetime thrillers, obscure cult classics, and if we’re honest… most Nic Cage and Jason Statham movies. Plus, sometimes they’re even joined by hilarious guests like Seth Rogen, Conan O’Brien, Amy Schume ...

… continue reading

Artwork

1
Doug Loves Movies

Misfit Toys

337k

1k

4d ago4d ago

Weekly

Comedian Doug Benson (Super High Me, Last Comic Standing) invites his friends to sit down and discuss his first love: movies!

… continue reading

Artwork

1
Planet Money

NPR

288k

355

1d ago1d ago

Weekly+

Wanna see a trick? Give us any topic and we can tie it back to the economy. At Planet Money, we explore the forces that shape our lives and bring you along for the ride. Don't just understand the economy – understand the world. Wanna go deeper? Subscribe to Planet Money+ and get sponsor-free episodes of Planet Money, The Indicator, and Planet Money Summer School. Plus access to bonus content. It's a new way to support the show you love. Learn more at plus.npr.org/planetmoney

… continue reading

Artwork

1
TED Talks Daily

TED

2471k

2k

8h ago8h ago

Daily

Want TED Talks on the go? Everyday, this feed brings you our latest talks in audio format. Hear thought-provoking ideas on every subject imaginable – from Artificial Intelligence to Zoology, and everything in between – given by the world's leading thinkers and doers. This collection of talks, given at TED and TEDx conferences around the globe, is also available in video format. Hosted on Acast. See acast.com/privacy for more information.

… continue reading

Artwork

1
NBC Nightly News with Tom Llamas

NBC News

2127k

600

1d ago1d ago

Daily

Listen to "NBC Nightly News," providing reports and analysis of the day's most newsworthy national and international events. This audio podcast, updated each evening, brings you the day's show in its entirety. For more from "Nightly News", visit NBCNightlyNews.com.

… continue reading

Artwork

1
The World This Hour

CBC

1992k

1

10h ago10h ago

Daily+

Catch up on the day's most important news from Canada and around the world in 5 minutes. Updated every hour, 24/7.

… continue reading

Artwork

1
Daily Boost Motivation and Coaching

Scott Smith - Motivation and Coaching

610k

1k

16h ago16h ago

Daily

The Daily Boost with Scott Smith Successful but still searching? Get the daily motivation you need to face your passion every day. With over 100 million downloads since 2006, The Daily Boost delivers practical motivation for driven professionals and entrepreneurs who refuse to settle for "good enough." Host Scott Smith cuts through the noise with bite-sized episodes that get straight to what matters—helping you do what you love and make a great living while doing it. Based on the proven Face ...

… continue reading

Artwork

1
Radiolab

WNYC Studios

629k

150

6d ago6d ago

Weekly

Radiolab is on a curiosity bender. We ask deep questions and use investigative journalism to get the answers. A given episode might whirl you through science, legal history, and into the home of someone halfway across the world. The show is known for innovative sound design, smashing information into music. It is hosted by Lulu Miller and Latif Nasser.

… continue reading

Artwork

1
Science Friday

Science Friday and WNYC Studios

353k

150

20h ago20h ago

Daily

Covering the outer reaches of space to the tiniest microbes in our bodies, Science Friday is the source for entertaining and educational stories about science, technology, and other cool stuff.

… continue reading

Artwork

1
This American Life

This American Life

668k

18

4d ago4d ago

Monthly

Each week we choose a theme. Then anything can happen. This American Life is true stories that unfold like little movies for radio. Personal stories with funny moments, big feelings, and surprising plot twists. Newsy stories that try to capture what it’s like to be alive right now. It’s the most popular weekly podcast in the world, and winner of the first ever Pulitzer Prize for a radio show or podcast. Hosted by Ira Glass and produced in collaboration with WBEZ Chicago.

… continue reading

Artwork

1
Criminal

Vox Media Podcast Network

379k

338

7d ago0w ago

Weekly

Criminal is the first of its kind. A show about people who’ve done wrong, been wronged, or gotten caught somewhere in the middle. Hosted by Phoebe Judge. Named a Best Podcast of 2023 by the New York Times. Part of the Vox Media Podcast Network.

… continue reading

Artwork

1
Sword and Scale

Sword and Scale

84k

71

4d ago4d ago

Monthly+

Sword and Scale is a weekly true crime podcast covering the dark underworld of crime and the criminal justice system’s response to it. The first episode launched January 1st, 2014 and feature stories of murder, abduction, rape, and even more bizarre forms of crime. It’s the purest form of true-crime where the raw uncensored audio tells the story. Everything from 911 calls to court testimony, interviews with victims and sometimes with perpetrators give listeners a 360 degree look at the seedy ...

… continue reading

Artwork

1
In The Dark

The New Yorker

82k

64

4M ago17w ago

Monthly

In the Dark, hosted by Madeleine Baran, is an award-winning investigative-journalism podcast that started in 2016. Its first season looked at the mysterious abduction of Jacob Wetterling in rural Minnesota and the lack of accountability that sheriffs face when they fail to solve cases. Season 2 examined the case of Curtis Flowers, who was tried six times for the same crime. In 2020, In the Dark released a special report on the coronavirus pandemic in the Mississippi Delta. In 2023, In the Da ...

… continue reading

Help/FAQ | Advertise with Us

Arts|Business|Comedy|Economics|Entertainment|News|Politics|Religion

Science|Soccer|Sports|Storytelling|Technology|True Crime

Copyright 2025 | Privacy Policy | Terms of Service | | Copyright

Listen to this show while you explore