Connecting...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9zawduawz5lxrly2hub2xvz3kvanbnl2jhbm5lci1kzwzhdwx0lmpwzyjdxq

Senior Data Engineer - Scala Python Spark

Senior Data Engineer - Scala Python Spark

Job title Senior Data Engineer - Scala Python Spark
Contract type: Permanent
Location London
Industry: Delivery, Software Engineering, Data
Salary: £70,000 - 85,000
Visa requirement: Applicants must be eligible to work in the specified location
Reference: SDEDLDN
Contact name: Michael Baker
Contact email: michael.baker@signifytechnology.com
Published: May 17, 2019 3:44

Job Description

Technical Requirements/Stack:

  • Scala
  • Spark
  • Python
  • Hadoop
  • Elasticsearch
  • PostgreSQL
  • Kafka
  • Redis
  • Expert knowledge in either Java, Scala or Python.
  • Ability to work with large volumes of data with distributed systems.
  • In-depth knowledge of data modelling, access and storage techniques.
  • Experience leading data infrastructure and ETL projects.
  • Experience with Unix systems.
  • Experience with machine learning (bonus).

 

Responsibilities:

Improve and upgrade the existing data processing toolset to help boost the global expansion effort, whilst ensuring consistency and reliability across the existing products and services. Find solutions to deal with the challenges faced when dealing with the problems in increases data volumes, assessing data quality and services to extract insight from the datasets.

 

The Company:

The platform allows users to access business information for companies in over 20 countries and is used as a tool to check customer information, find new business and perform general risk assessment.