 |
Data DrivenExploring Machine Learning, AI, and Data Science Author: Data Driven
Data Driven: the podcast where we explore the emerging field of Data Science. We bring the best minds in Data, Software Engineering, Machine Learning, and Artificial Intelligence right to you every Tuesday. The field of data science mashes up the worlds of statistics, database architecture and software engineering. Data Scientist has been labelled by the Harvard Business Review, as "the sexiest job of the 21st century." A quick search of job search sites reveal that this field is in high demand. In a world where Data is the new Oil, Data Science the new Refineries, consider this Car Talk for the Data Age. Every week we bring the best minds in this emerging field straight to you. Our goal is to educate and inspire our listeners so that they can be prepared to thrive in a Data Driven world. Language: en Genres: Life Sciences, Science, Technology Contact email: Get it Feed URL: Get it iTunes ID: Get it |
Listen Now...
Governance, Architecture, and the Evolving Role of Data Engineers in the AI Age
Episode 20
Sunday, 26 April, 2026
In this week’s show, Frank La Vigne sits down with data and analytics engineer Wasim Rana for a deep dive into the realities of building, managing, and securing data infrastructure in modern businesses. Together, they explore the critical challenge of preventing data lakes from turning into data swamps, the practical pipeline from raw to curated data—including the increasingly popular bronze, silver, and gold layering approach—and the vital role of governance in today’s data-heavy world. Waseem Rana shares insights from his hands-on experience with AWS, Snowflake, and transforming messy datasets into actionable business intelligence. The conversation also takes a look at the evolving landscape of data engineering amid AI advancements, what skills data professionals need to stay ahead, and how future architectures may blend data lakes, warehouses, and vector databases for AI-driven analytics. Whether you’re a data engineer, business leader, or just curious about the future of data, this is an episode you won’t want to miss!LinksWasim's LinkedIn -https://www.linkedin.com/in/iamwasimrana/Wasim's GitHub -https://github.com/wasimranacseWatch on YouTube -https://youtu.be/8oGEEN6BubkPodcast Episode Mentioned:The AI Driven Leader: Rethinking Strategy, Decision Making, and Personal Growth -https://datadriven.tv/episodes/the-ai-driven-leader-rethinking-strategy-decision-making-and-personal-growth/Book mentioned:The AI-Driven Leader: Harnessing AI to Make Faster, Smarter DecisionsHardcover -https://amzn.to/4crqshxKindle -https://amzn.to/4u8rVPSAudiobook -https://amzn.to/3Qqsc1XTime Stamp00:00 Working as a data engineer03:22 Using AWS for infrastructure06:31 Transforming raw data for use11:14 Discussing data sources and ingestion15:51 Discussing data analysis with AI models16:33 The future of data analytics21:58 Importance of data governance24:44 Evolution of data storage solutions29:34 AI's impact on data jobs31:20 Understanding data architecture importance35:49 Understanding AI creativity and context37:14 Understanding AI's lack of context40:43 Difficulty finding meaningful connections45:14 Using storytelling to drive change47:44 Connecting pipelines to WooCommerce
