Connecting...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9zawduawz5lxrly2hub2xvz3kvanbnl2jhbm5lci1kzwzhdwx0lmpwzyjdxq

Keeping the “fun” in Apache Spark Datasets and FP by Holden Karau

W1siziisijiwmtgvmtivmjcvmtqvmzqvmtivnjcxl3blegvscy1wag90by03nje1ndcuanblzyjdlfsiccisinrodw1iiiwiotawedkwmfx1mdazzsjdxq

Was it Apache Spark that initiated your interest in Scala or functional programming concepts? 

Spark is leading towards newer DataFrame & Dataset APIs but don't forget we need to keep looking at how we can benefit from this while still keeping the functional roots. Lucky for us, Holden Karau helps us to remember this.

 

 
Keeping the “fun” in Apache Spark Datasets and FP

Apache Spark has been a great driver of not only Scala adoption, but introducing a new generation of developers to functional programming concepts. 

As Spark places more emphasis on its newer DataFrame & Dataset APIs, it’s important to ask ourselves how we can benefit from this while still keeping our fun functional roots. We will explore the cases where the Dataset APIs empower us to do cool things we couldn’t before, what the different approaches to serialization mean, and how to figure out when the shiny new API is actually just trying to steal your lunch money (aka CPU cycles).