Connecting...

Banner Default Image

Senior Data Engineer

Job title Senior Data Engineer
Location San Francisco, United States
Industry:
Reference: 2382
Contact name: Ian Kanewski
Contact email: ian.kanewski@signify-tech.com
Published: November 18, 2021 3:27

Job Description

PLEASE NOTE THIS IS A 6 MONTH CONTRACT ROLE WITH HIGH PROBABILITY OF EXTENSIONS

CURRENTLY UNABLE TO ACCEPT C2C OR H1B VISA CANDIDATES FOR THIS POSITION

Rate: $80-$100/hr

Are you looking for a chance to work on massive data projects at one of the world's top social media platforms?

We are looking to add several Data Engineer contractors to a remote team working on a data migration project.

What you’ll do:

  • Actively contribute to migrating platform from Scalding to BigQuery
  • Work with massive data sets
  • Solve data issues and ML problems

Ideal Candidate will have:

  • Demonstrated ability to understand recurring patterns
  • Experience with semi-automated migration tooling
  • History of data processing in prior roles
  • Understanding of MapReduce

Minimum Requirements:

  • Highly fluent in at least one JVM language such as ScalaJava, and Python
  • Proficiency with Scala and prior experience with Scalding is highly desired
  • Demonstrated experience with GCP platform
  • Experience with BigQuery, Dataflow, and Apache Beam or Spark
  • Bachelor’s or Master's degree in Computer Science, Engineering, Computer Information Systems, Mathematics, Physics, or a related field or software development training program

Stand out with

  • Prior experience with data scalability
  • Experience working on large scale consumer facing products