Canadian Data Guy Unfiltered

Canadian Data Guy Unfiltered

Home
Podcast
Notes
Chat
TL;DR
Deep Dive
Youtube
About

Inside Delta Lake’s Idempotency Magic: The Secret to Exactly-Once Spark

Learn how txnAppId and epochId work together to create a bulletproof distributed two-phase commit. Achieve true exactly-once semantics for your production pipelines
LATEST
·
6:18
17:55
Unlocking Sub-Second Latency with Databricks
Watch now | How Spark Real Time Mode Achieving Millisecond Latency with a Simple Trigger Switch
 • Canadian Data Guy
13:41
I Knew the Answer. I Just Couldn’t Remember It.
How you can turn your notes into a personal Knowledge Agent — no code required
 • Canadian Data Guy
How to Choose Between Liquid Clustering and Partitioning with Z-Order in Databricks
The views expressed in this blog are my own and do not represent official guidance from Databricks
 • Canadian Data Guy and Geethu
26:05
Stop Waiting for Connectors: Stream ANYTHING into Spark (It's 4 Functions)
Listen now | How to ingest data from any source into Apache Spark — demystified with real-world example of BlockChain Ingestion
 • Canadian Data Guy and Yogita Nesargi
4 Surprising Truths That Will Change How You Think About Spark Streaming
Spark gives you Real-Time without the complexity and pain
 • Canadian Data Guy
Why I Materialize Delta History for Debugging
Just a Quick Tip
 • Canadian Data Guy
How to write your first Spark application with Stream-Stream Joins with working code
A Practical, Hands-On Guide to Joining Real-Time Data Streams in Spark Structured Streaming
 • Canadian Data Guy
Build an Ethereum ETL Pipeline for Free Using Databricks Free Edition
Build a zero-infrastructure streaming pipeline: Step-by-step Ethereum data ingestion, schema evolution, and Delta storage
 • Yogita Nesargi
How to ace and structure your Data Modelling Interview
Prescriptive guidance for conducting your Data Modelling Interview
 • Canadian Data Guy
Canadian Data Guy Unfiltered
Canadian Data Guy Unfiltered
The engineer who writes documentation-grade deep dives with production code you can run today
Recommendations
Databricksters
Databricksters
Canadian Data Guy

Canadian Data Guy Unfiltered

AboutArchiveRecommendationsSitemap
© 2026 Canadian Data Guy · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture