Tech Lead - Big Data - Spark/Scala/Java

Job Description

A premier company that works with hundreds of customers across the United States is currently looking to hire a hands-on Team Lead that is a subject matter expert in Big Data and working with Spark, Kafka, and Scala. The data they handle spans hundreds of millions of customers and they support tens of billions of events per day. This is not a people management role so you will essentially be sharing your expertise within the space as a leader for the Data Engineering team. You will be responsible for the optimization, creation, and management of large-scale Data sets and ETL pipelines/processes. Strong familiarity with Data Structures, Algorithms, Performance, and Scalability is necessary. Ideally, they are looking for people who already have prior experience with high-volume, large-scale, and complex data sets. If you have a passion for massive amounts of data and want to be a subject leader at a growing company, this role would be a great fit for you!

Required Experience

• 6+ years of professional Data Engineering experience
• 2+ years working with Big Data tools and technologies
• Expert-level Scala experience
• Production experience with: Spark, Kafka, and Hadoop
• Strong experience building out ETL pipelines from scratch
• Prior experience as an SME for a Data team

Desired Experience

• Familiar with working in an AWS environment
• Proven history working with large amounts of data
• Experience with working on Distributed Systems
• Strong communication skills
• Good understanding of Data Structures and Algorithms
• Bachelor's or Master's in Computer Science or similar

Benefits

• Total Compensation: up to $180,000 base salary + 10% Bonus
• Covered Health / Vision / Dental Insurance
• 401(k)
• Generous PTO
• Fully remote work support for US-based hires

Note: This full-time position is available only to those with valid US work authorization. We will not be able to consider third-party candidates for this position.