In this talk from Scale by the Bay Sharanya Santhanam and Shiv Toolsidass discuss real-time data and the challenges it brings.
In this talk, we'll learn more about how Apache Druid powers alerting against real-time data at Lyft, which is useful for several use cases including validating A/B tests, accuracy of emails sent out to customers and for internal tools. We'll talk about the challenges we faced while setting up our real-time ingestion pipeline into Druid using Apache Flink and Kafka, and how we went about solving them.