Data Platform — The Challenges (Part 1)
The scalability and autonomy challenges involved in building data platforms.
#data-platforms
4 posts
Data Platform — Solution for Consumption (Part 2)
A decoupled architecture for analytical data storage, cataloging, and processing.
From Full Loads to Incremental Processing: Computing Changes Is Not Enough
How monotonicity, coordination, and the information preserved by a pipeline explain the boundaries between full loads and incremental processing.
Journey to Real-Time Analytics - Lakehouse Is Not the Solution
Why support for updates and streaming ingestion does not turn Apache Iceberg into a real-time analytics layer.