Best Data Lake Architecture Podcasts (2025)

Summary In this episode of the Data Engineering Podcast Vijay Subramanian, founder and CEO of Trace, talks about metric trees - a new approach to data modeling that directly captures a company's business model. Vijay shares insights from his decade-long experience building data practices at Rent the Runway and explains how the modern data stack has…

1
From GPUs-as-a-Service to Workloads-as-a-Service: Flex AI’s Path to High-Utilization AI Infra 56:31

Play Pause

11d ago56:31

56:31

Summary In this crossover episode of the AI Engineering Podcast, host Tobias Macey interviews Brijesh Tripathi, CEO of Flex AI, about revolutionizing AI engineering by removing DevOps burdens through "workload as a service". Brijesh shares his expertise from leading AI/HPC architecture at Intel and deploying supercomputers like Aurora, highlighting…

1
From RAG to Relational: How Agentic Patterns Are Reshaping Data Architecture 52:58

21d ago52:58

52:58

Summary In this episode of the AI Engineering Podcast Mark Brooker, VP and Distinguished Engineer at AWS, talks about how agentic workflows are transforming database usage and infrastructure design. He discusses the evolving role of data in AI systems, from traditional models to more modern approaches like vectors, RAG, and relational databases. Ma…

1
Duck Lake: Simplifying the Lakehouse Ecosystem 1:10:41

29d ago1:10:41

1:10:41

Summary In this episode of the Data Engineering Podcast Hannes Mühleisen and Mark Raasveldt, the creators of DuckDB, share their work on Duck Lake, a new entrant in the open lakehouse ecosystem. They discuss how Duck Lake, is focused on simplicity, flexibility, and offers a unified catalog and table format compared to other lakehouse formats like I…

1
Aligning Business and Data: The Essential Role of Data Modeling 1:06:51

1M ago1:06:51

1:06:51

Summary In this episode of the Data Engineering Podcast Serge Gershkovich, head of product at SQL DBM, talks about the socio-technical aspects of data modeling. Serge shares his background in data modeling and highlights its importance as a collaborative process between business stakeholders and data teams. He debunks common misconceptions that dat…

1
From Academia to Industry: Bridging Data Engineering Challenges 50:54

1M ago50:54

50:54

Summary In this episode of the Data Engineering Podcast Professor Paul Groth, from the University of Amsterdam, talks about his research on knowledge graphs and data engineering. Paul shares his background in AI and data management, discussing the evolution of data provenance and lineage, as well as the challenges of data integration. He explores t…

1
High Performance And Low Overhead Graphs With KuzuDB 1:01:29

2M ago1:01:29

1:01:29

Summary In this episode of the Data Engineering Podcast Prashanth Rao, an AI engineer at KuzuDB, talks about their embeddable graph database. Prashanth explains how KuzuDB addresses performance shortcomings in existing solutions through columnar storage and novel join algorithms. He discusses the usability and scalability of KuzuDB, emphasizing its…

1
Bridging Data and Decision-Making: AI's Role in Modern Analytics 1:10:44

2M ago1:10:44

1:10:44

Summary In this episode of the Data Engineering Podcast Lucas Thelosen and Drew Gilson from Gravity talk about their development of Orion, an autonomous data analyst that bridges the gap between data availability and business decision-making. Lucas and Drew share their backgrounds in data analytics and how their experiences have shaped their approa…

1
From Bits to Tables: The Evolution of S3 Storage 50:08

2M ago50:08

50:08

Summary In this episode of the Data Engineering Podcast Andy Warfield talks about the innovative functionalities of S3 Tables and Vectors and their integration into modern data stacks. Andy shares his journey through the tech industry and his role at Amazon, where he collaborates to enhance storage capabilities, discussing the evolution of S3 from …

1
Revolutionizing Python Notebooks with Marimo 51:56

2M ago51:56

51:56

Summary In this episode of the Data Engineering Podcast Akshay Agrawal from Marimo discusses the innovative new Python notebook environment, which offers a reactive execution model, full Python integration, and built-in UI elements to enhance the interactive computing experience. He discusses the challenges of traditional Jupyter notebooks, such as…

1
Warehouse Native Incremental Data Processing With Dynamic Tables And Delayed View Semantics 55:07

3M ago55:07

55:07

Summary In this episode of the Data Engineering Podcast Dan Sotolongo from Snowflake talks about the complexities of incremental data processing in warehouse environments. Dan discusses the challenges of handling continuously evolving datasets and the importance of incremental data processing for optimized resource use and reduced latency. He expla…

1
Streamlining Data Pipelines with MCP Servers and Vector Engines 52:04

3M ago52:04

52:04

Summary In this episode of the Data Engineering Podcast Kacper Łukawski from Qdrant about integrating MCP servers with vector databases to process unstructured data. Kacper shares his experience in data engineering, from building big data pipelines in the automotive industry to leveraging large language models (LLMs) for transforming unstructured d…

1
Foundational Data Engineering At Two Sigma 55:05

3M ago55:05

55:05

Summary In this episode of the Data Engineering Podcast Effie Baram, a leader in foundational data engineering at Two Sigma, talks about the complexities and innovations in data engineering within the finance sector. She discusses the critical role of data at Two Sigma, balancing data quality with delivery speed, and the socio-technical challenges …

1
The Hour of (data) Power 47:40

3M ago47:40

47:40

Ready for your Hour of (Data) Power with some Radioactive and Electric Feel thrown in? Ok, so hang tight, get your coffee or lemonade (depending on how your summer looks like!), as we bring you a double whammy from your newest Data-powered Innovation Jam to celebrate the anniversary launch of the 10th edition of the Data Powered Innovation Review. …

1
Enabling Agents In The Enterprise With A Platform Approach 54:18

3M ago54:18

54:18

Summary In this episode of the Data Engineering Podcast Arun Joseph talks about developing and implementing agent platforms to empower businesses with agentic capabilities. From leading AI engineering at Deutsche Telekom to his current entrepreneurial venture focused on multi-agent systems, Arun shares insights on building agentic systems at an org…

1
Dagster's New Era: Modularizing Data Transformation in the Age of AI 1:01:37

4M ago1:01:37

1:01:37

Summary In this episode of the Data Engineering Podcast we welcome back Nick Schrock, CTO and founder of Dagster Labs, to discuss the evolving landscape of data engineering in the age of AI. As AI begins to impact data platforms and the role of data engineers, Nick shares his insights on how it will ultimately enhance productivity and expand softwa…

1
AI and the Lakehouse: How Starburst is Pioneering New Workflows 44:09

4M ago44:09

44:09

Summary In this episode of the Data Engineering Podcast Alex Albu, tech lead for AI initiatives at Starburst, talks about integrating AI workloads with the lakehouse architecture. From his software engineering roots to leading data engineering efforts, Alex shares insights on enhancing Starburst's platform to support AI applications, including an A…

1
Every doc you take 43:30

4M ago43:30

43:30

From punk rock to process automation, from Blondie to BSON — it’s a genre-defying episode of the Data-Powered Innovation Jam where we grab a virtual bench in Central Park with Andrew Davidson, SVP of Products at MongoDB, and let the data conversation run wild. What follows is an improvisational jam session on the evolution of data, the art of distr…

1
Amazon S3: The Backbone of Modern Data Systems 1:01:01

4M ago1:01:01

1:01:01

Summary In this episode of the Data Engineering Podcast Mai-Lan Tomsen Bukovec, Vice President of Technology at AWS, talks about the evolution of Amazon S3 and its profound impact on data architecture. From her work on compute systems to leading the development and operations of S3, Mylan shares insights on how S3 has become a foundational element …

1
Scaling Data Operations With Platform Engineering 42:20

4M ago42:20

42:20

Summary In this episode of the Data Engineering Podcast Chakravarthy Kotaru talks about scaling data operations through standardized platform offerings. From his roots as an Oracle developer to leading the data platform at a major online travel company, Chakravarthy shares insights on managing diverse database technologies and providing databases a…

1
From Data Discovery to AI: The Evolution of Semantic Layers 49:30

5M ago49:30

49:30

Summary In this episode of the Data Engineering Podcast, host Tobias Macy welcomes back Shinji Kim to discuss the evolving role of semantic layers in the era of AI. As they explore the challenges of managing vast data ecosystems and providing context to data users, they delve into the significance of semantic layers for AI applications. They dive i…

1
The six pistols of technology trends 1:18:45

5M ago1:18:45

1:18:45

Ready for the remix? You might have already listened to one of the most recent episodes of the Cloud Realities podcast, where six dynamic voices from two podcast teams came together to unpack Capgemini’s TechnoVision 2025. From infrastructure and applications to collaboration, user experience, automation, and — naturally — a heavy dose of data and …

1
Balancing Off-the-Shelf and Custom Solutions in Data Engineering 46:05

5M ago46:05

46:05

Summary In this episode of the Data Engineering Podcast Tulika Bhatt, a senior software engineer at Netflix, talks about her experiences with large-scale data processing and the future of data engineering technologies. Tulika shares her journey into the data engineering field, discussing her work at BlackRock and Verizon before joining Netflix, and…

1
Models on the dance floor 43:10

5M ago43:10

43:10

What happens when Professor Erik Proper of the Technical University of Vienna teams up with the ever-inquisitive ‘Dr. Bob’ Robert Engels – modestly supported by co-hosts Weiwei Feng and Ron Tolido - to discuss AI, models, semantics, ontologies, and context? A true PhD Fest? Or a practical exploration of the synergies between the academic and busine…

1
StarRocks: Bridging Lakehouse and OLAP for High-Performance Analytics 59:41

5M ago59:41

59:41

Summary In this episode of the Data Engineering Podcast Sida Shen, product manager at CelerData, talks about StarRocks, a high-performance analytical database. Sida discusses the inception of StarRocks, which was forked from Apache Doris in 2020 and evolved into a high-performance Lakehouse query engine. He explains the architectural design of Star…

1
Exploring NATS: A Multi-Paradigm Connectivity Layer for Distributed Applications 1:12:50

5M ago1:12:50

1:12:50

Summary In this episode of the Data Engineering Podcast Derek Collison, creator of NATS and CEO of Synadia, talks about the evolution and capabilities of NATS as a multi-paradigm connectivity layer for distributed applications. Derek discusses the challenges and solutions in building distributed systems, and highlights the unique features of NATS t…

1
You can’t touch this (Data) 34:25

6M ago34:25

34:25

Much like a hammer sees every problem as a nail, data experts tend to see opportunity in every single data field. Collaboration on data is still one of the best ways to bring data to life and build business value on top of it. Sharing data across organizations is one of the most powerful ways to spark innovation. But when data needs to stay private…

1
Advanced Lakehouse Management With The LakeKeeper Iceberg REST Catalog 57:13

6M ago57:13

57:13

Summary In this episode of the Data Engineering Podcast Viktor Kessler, co-founder of Vakmo, talks about the architectural patterns in the lake house enabled by a fast and feature-rich Iceberg catalog. Viktor shares his journey from data warehouses to developing the open-source project, Lakekeeper, an Apache Iceberg REST catalog written in Rust tha…

1
Simplifying Data Pipelines with Durable Execution 39:49

6M ago39:49

39:49

Summary In this episode of the Data Engineering Podcast Jeremy Edberg, CEO of DBOS, about durable execution and its impact on designing and implementing business logic for data systems. Jeremy explains how DBOS's serverless platform and orchestrator provide local resilience and reduce operational overhead, ensuring exactly-once execution in distrib…

1
Smells like gene spirit 44:18

6M ago44:18

44:18

Ever thought AI practitioners could win a Noble prize? Well, they already have. Not for predicting your next favourite movie or generating poetry, but for groundbreaking advancements in Life Sciences. And it won’t be the last time. In this episode, hosts Ron Tolido, Robert Engels, and Weiwei Feng find themselves venturing into unexpected territory …

1
Overcoming Redis Limitations: The Dragonfly DB Approach 43:58

6M ago43:58

43:58

Summary In this episode of the Data Engineering Podcast Roman Gershman, CTO and founder of Dragonfly DB, explores the development and impact of high-speed in-memory databases. Roman shares his experience creating a more efficient alternative to Redis, focusing on performance gains, scalability, and cost efficiency, while addressing limitations such…

1
Ventures in space 49:06

7M ago49:06

49:06

In for a new venture? This episode of the Data-powered Innovation Jam has you covered. Our hosts Weiwei, Robert, and Ron welcome Brett Clark, Director, Global Business Development at blackshark.ai—a company with the modest mission of creating a digital twin of the entire planet using satellite data. It all started with Microsoft Flight Simulator, b…

1
Bringing AI Into The Inner Loop of Data Engineering With Ascend 52:47

7M ago52:47

52:47

Summary In this episode of the Data Engineering Podcast Sean Knapp, CEO of Ascend.io, explores the intersection of AI and data engineering. He discusses the evolution of data engineering and the role of AI in automating processes, alleviating burdens on data engineers, and enabling them to focus on complex tasks and innovation. The conversation cov…

1
Astronomer's Role in the Airflow Ecosystem: A Deep Dive with Pete DeJoy 51:41

7M ago51:41

51:41

Summary In this episode of the Data Engineering Podcast Pete DeJoy, co-founder and product lead at Astronomer, talks about building and managing Airflow pipelines on Astronomer and the upcoming improvements in Airflow 3. Pete shares his journey into data engineering, discusses Astronomer's contributions to the Airflow project, and highlights the cr…

1
RightHere, RightNow 45:25

7M ago45:25

45:25

It’s the ultimate new hit album for generative AI: intelligent automation, autonomous systems, and—of course—agents. But while ServiceNow has been a pioneering force in this space for a long time, it still seems to fly under the radar for many data and AI experts. Time to change that. Time to bridge the worlds of Planet Process and Planet Data! For…

1
Accelerated Computing in Modern Data Centers With Datapelago 55:36

7M ago55:36

55:36

Summary In this episode of the Data Engineering Podcast Rajan Goyal, CEO and co-founder of Datapelago, talks about improving efficiencies in data processing by reimagining system architecture. Rajan explains the shift from hyperconverged to disaggregated and composable infrastructure, highlighting the importance of accelerated computing in modern d…

1
Let’s swing to TechnoVision 44:04

8M ago44:04

44:04

"It Don’t Mean a Thing If It Ain’t Got That Swing"—Duke Ellington’s immortal words composed almost a century ago resonate deeply in the latest episode of the Data-powered Innovation Jam. Hosts Ron Tolido, Robert Engels, and Weiwei Feng explore TechnoVision 2025, Capgemini’s annual technology trend analysis, where ‘The Pendulum Swing’ captures the r…

1
The Future of Data Engineering: AI, LLMs, and Automation 59:39

8M ago59:39

59:39

Summary In this episode of the Data Engineering Podcast Gleb Mezhanskiy, CEO and co-founder of DataFold, talks about the intersection of AI and data engineering. He discusses the challenges and opportunities of integrating AI into data engineering, particularly using large language models (LLMs) to enhance productivity and reduce manual toil. The c…

1
Evolving Responsibilities in AI Data Management 38:57

8M ago38:57

38:57

Summary In this episode of the Data Engineering Podcast Bartosz Mikulski talks about preparing data for AI applications. Bartosz shares his journey from data engineering to MLOps and emphasizes the importance of data testing over software development in AI contexts. He discusses the types of data assets required for AI applications, including exten…

1
Cloud encounters of the third kind 43:25

8M ago43:25

43:25

Cloud computing has long been a familiar fixture in the digital sky, but that doesn’t mean innovation has stopped soaring. In this episode, hosts Ron Tolido, Robert Engels, and Weiwei Feng discuss all things cloud with Carolin Eggers, Director, Data & AI, EMEA North, Google Cloud. The first kind of cloud? There’s nothing UFO about it. That’s well u…

1
Quantum heart mother 39:09

8M ago39:09

39:09

Is quantum computing an early ‘70s thing? Well, certainly if you compare it to the new, experimental music that was released then. To many, quantum computing feels like listening to an early Pink Floyd record for the very first time: alien, incomparable, confusing, but above all: intriguing. Quite different from the more mainstream band the Floyd l…

1
The red and blue pills of Virtual Twins 40:51

9M ago40:51

40:51

Knock, knock, Neo. Think Agents are a thing of the future? Look again at the iconic movie, The Matrix—they've been hiding in plain sight. In the first episode of 2025, hosts Ron Tolido, Weiwei Feng, and Robert Engels venture down the digital rabbit hole of Virtual Twins with Morgan Zimmerman, CEO of NETVIBES at Dassault Systèmes. It’s a fascinating…

1
CSVs Will Never Die And OneSchema Is Counting On It 54:40

9M ago54:40

54:40

Summary In this episode of the Data Engineering Podcast Andrew Luo, CEO of OneSchema, talks about handling CSV data in business operations. Andrew shares his background in data engineering and CRM migration, which led to the creation of OneSchema, a platform designed to automate CSV imports and improve data validation processes. He discusses the ch…

1
Breaking Down Data Silos: AI and ML in Master Data Management 57:30

9M ago57:30

57:30

Summary In this episode of the Data Engineering Podcast Dan Bruckner, co-founder and CTO of Tamr, talks about the application of machine learning (ML) and artificial intelligence (AI) in master data management (MDM). Dan shares his journey from working at CERN to becoming a data expert and discusses the challenges of reconciling large-scale organiz…

1
Building a Data Vision Board: A Guide to Strategic Planning 49:59

10M ago49:59

49:59

Summary In this episode of the Data Engineering Podcast Lior Barak shares his insights on developing a three-year strategic vision for data management. He discusses the importance of having a strategic plan for data, highlighting the need for data teams to focus on impact rather than just enablement. He introduces the concept of a "data vision boar…

1
Predicting in the name of 49:47

10M ago49:47

49:47

Do we hear sleigh bells in that surf rock soundtrack? Well, anything can happen when you tune in to the Data-powered Innovation Jam podcast—especially in the very last episode of the year! Our hosts Weiwei Feng (winning top honours for her Christmas sweater), Robert Engels, and Ron Tolido gather with their producer Arne Rossmann by a cozy fireplace…

1
How Orchestration Impacts Data Platform Architecture 59:39

10M ago59:39

59:39

Summary The core task of data engineering is managing the flows of data through an organization. In order to ensure those flows are executing on schedule and without error is the role of the data orchestrator. Which orchestration engine you choose impacts the ways that you architect the rest of your data platform. In this episode Hugo Lu shares his…

1
Sweet autonomous o'mine 44:48

10M ago44:48

44:48

Autonomous AI isn’t just a futuristic dream—it’s here, and robots are redefining industries. But who would have thought the human touch is so crucial to success? In this electrifying episode, hosts Robert Engels, Weiwei Feng, and Ron Tolido are joined by Kence Anderson, CEO and co-founder of Composabl and author of “Designing Autonomous AI: A Guide…

1
An Exploration Of The Impediments To Reusable Data Pipelines 51:32

10M ago51:32

51:32

Summary In this episode of the Data Engineering Podcast the inimitable Max Beauchemin talks about reusability in data pipelines. The conversation explores the "write everything twice" problem, where similar pipelines are built without code reuse, and discusses the challenges of managing different SQL dialects and relational databases. Max also touc…