Data Platform Engineers

Data Platform Engineers

Job title Data Platform Engineers
Contract type: Permanent
Location San Francisco
Industry: Software Engineering
Salary: $200,000 - 250,000
Visa requirement: Applicants must be eligible to work in the specified location
Reference: DP0403
Contact name: Charlie Murdoch
Contact email:
Published: September 17, 2018 7:24

Job Description

Data Platform Engineer

San Francisco, New York or Chicago

The Company

Signify Technology are working with a leading location intelligence company with offices located on both the East Coast and West Coast. Their mobile application provides personalised recommendations of their user’s current locations by using data and algorithms. The data is picked up from the user’s previous browsing history. 

Our client makes sure that every member of the team is valued and regularly hosts meetups for them to learn, as well as get involved in the tech community.  

The Role

  • Build seamless ways to run pipelines on their Hadoop clusters
  • Scale all aspects of the data lake systems
  • Work on distributed systems to drive the services for their products
  • Working on infrastructure challenges and any problems you come across
  • Comfortable sharing your ideas to improve the quality of the product
  • Build and maintain their infrastructure

You will have-

  • 3+ years of working on Hadoop clusters
  • BSc in Computer Science or equivalent
  • Strong knowledge of the Hadoop ecosystem – Spark, Kafka, Hive, HDFS, Yarn
  • Chef, Puppet, Ansible
  • Hadoop infrastructure
  • AWS
  • Luigi Scheduler is desirable

Signify Technology Group

 Signify Technology are a forward-thinking technology recruitment business with our head office based in the heart of London. Signify Technology provide permanent and contract technology recruitment solutions to a range of clients from technology companies, global brands and start-ups globally. Behind each piece of technology changing the world, is a person, it’s our mission to introduce them to the companies that need them the most. We Look forward to working with you.