Delta Lake is an open-source storage layer that brings reliability to data lakes. In his talk at Scale by the Bay, Michael Paul Armbrust discusses Delta Lake and how it improves open source reliability and quality.
Delta Lake offers ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. It runs on top of your existing data lake and is fully compatible with Apache Spark APIs.
This talk was given by Michael Paul Armbrust at Scale by the Bay.