Data Engineer III

Added: 01/07/2022

REF: 22763

Contract: Permanent

Location: Dublin, Ireland


The Opportunity

As an AI Engineer, you will play a key role in designing and driving our client's data integration pipelines, ETL/ELT, and analytic strategies across the enterprise. In this role, you will be bringing modern data technologies and practices to enable their talented team of data scientists to build, train, and deploy ML models. 

Responsibilities
  • Determine optimal solutions for integrating data from a variety of sources
  • Implement, maintain and monitor batch & stream data pipelines with best practice quality controls
  • Evaluate relevant new and mature technologies as needs, gaps, and opportunities arise
  • Work closely and collaboratively in an Agile environment with our analysts, engineers and product teams to analyze issues and find new insights covering our business and operations
  • Collaborate with our other data teams, as they are customers
  • Ability to identify problem patterns and apply solutions that enable our team to accelerate delivery
Requirements
  • Proficiency [4+ years] in Python and Java or Scala.
  • Experience in stream processing technology (Kafka, Spark etc)
  • Knowledge of SQL, data modeling and dimensional modeling concepts
  • Distributed and low latency (streaming) application architecture
  • Familiarity with API design
  • CI/CD systems experience (Jenkins, Github, etc)
  • Experience adhering to robust audit standards
  • AWS experience
  • BS or MS degree in Computer Science or Engineering related experience
Bonus Skills
  • Knowledge of emerging data integration technologies
  • Spark Streaming, Kafka Streams, Kafka Connect, etc
  • Exposure to Kubernetes and Helm
  • Data Science and model deployment pipeline experience
  • Familiarity with machine learning frameworks such as Tensorflow, scikit-learn or similar tools
  • Strong expertise/background with Linux

Apply Now

Complete the form below to apply for the Data Engineer III role:

Add Your CV

Alternatively select from

View all jobs