-
Book Overview & Buying
-
Table Of Contents
Engineering Lakehouses with Open Table Formats
By :
This chapter showcased the practical application of open table formats—Apache Iceberg, Apache Hudi, and Delta Lake—through real-world use cases that span manufacturing analytics, real-time CDC, and machine learning workflows.
We began with Acme Manufacturing’s journey to unify operational data using an Iceberg-based lakehouse. Their architecture, built with MinIO, Dremio, Nessie, and Superset, demonstrated how to implement a Bronze-Silver-Gold table model with Git-like data branching for WAP workflows. Iceberg’s support for schema evolution and SQL accessibility enabled seamless team adoption and real-time insights.
Next, we explored how GlobalMart leveraged Apache Hudi to implement a real-time CDC pipeline. By integrating Debezium, Kafka, Spark Structured Streaming, and Hudi, the team achieved near-real-time data freshness, time travel, and incremental query support. This architecture streamlined compliance reporting, reduced infrastructure...