Did you have the opportunity to head along to Lambda World Seattle? It was the first Lambda World to be held in Seattle and was a huge success with so many amazing speakers including the inspiring Big Data Developer Advocate and Software Development Engineer, Holden Karau. Check out Holden's talk from Seattle here on Bringing the Jewels of the Python World to Scala with Spark.
Bringing the Jewels of the Python World to Scala with Spark
With the new Apache Arrow integration in PySpark 2.3, it is now starting become reasonable to look to the Python world and ask “what else do we want to steal besides tensorflow”, or as a Python developer look and say “how can I get my code into production without it being rewritten into a mess of Java?”. Regardless of your specific side(s) in the JVM/Python divide, collaboration is getting a lot faster, so lets learn how to share! In this brief talk we will examine sharing some of the wonders of Spacy with the JVM world, which still has a somewhat lackluster set of options for NLP & deep learning.