Data Platform Engineer
San Francisco, New York or Chicago
Signify Technology are working with a leading location intelligence company with offices located on both the East Coast and West Coast. Their mobile application provides personalised recommendations of their user’s current locations by using data and algorithms. The data is picked up from the user’s previous browsing history.
Our client makes sure that every member of the team is valued and regularly hosts meetups for them to learn, as well as get involved in the tech community.
- Build seamless ways to run pipelines on their Hadoop clusters
- Scale all aspects of the data lake systems
- Work on distributed systems to drive the services for their products
- Working on infrastructure challenges and any problems you come across
- Comfortable sharing your ideas to improve the quality of the product
- Build and maintain their infrastructure
You will have-
- 3+ years of working on Hadoop clusters
- BSc in Computer Science or equivalent
- Strong knowledge of the Hadoop ecosystem – Spark, Kafka, Hive, HDFS, Yarn
- Chef, Puppet, Ansible
- Hadoop infrastructure
- Luigi Scheduler is desirable
Signify Technology Group
Signify Technology are a forward-thinking technology recruitment business with our head office based in the heart of London. Signify Technology provide permanent and contract technology recruitment solutions to a range of clients from technology companies, global brands and start-ups globally. Behind each piece of technology changing the world, is a person, it’s our mission to introduce them to the companies that need them the most. We Look forward to working with you.