Data Engineer

Added: 11/09/2019

REF: 756

Contract: Permanent

Location: Berlin, Germany

Data Engineer

Location: Berlin

Industry: Food Delivery

Salary: €70,000

 

Opportunity for a Senior Data Scientist to join a company and help them to build a Machine Learning Lab team that is being built from scratch.

 

After checking the data of every team, the conclusion has found out that the quality of data is the restriction from making this happen.

 

Now they have created a Big Data Lake. The plan is for the Data Lake to function like IBM’s Watsons and be the all in one place for data gathering and processing.  Next steps after this? introduce microservices to the Data Lake.

 

The overall goal of the machine learning lab is to help the company become a Data Driven organisation like Netflix.

 

Day to Day tasks:

  • Designing, implementing and maintaining batch, near-time and real-time data processing pipelines and analytical workflows.
  • ETL and data sync processes for cleaning and structuring data.
  • Extracting data from various 3rd party tools and APIs.
  • Proactively make suggestions on how the team can leverage new technologies and architectures to improve the performance of our data platform.

 

Core tech stack:

Python (Primary), AWS, SQL, ETL, Apache (Spark and Kafka), DevOps Tools (Docker, Cloud Formation)

Anthony Kelly
Speak to to Anthony Kelly or apply below

Sales Team Manager Anthony is a Recruitment Ninja who has won several awards for his excellent performance in the recruitment industry. 

Email: anthony@alldus.com

Apply Now

Complete the form below to apply for the Data Engineer role:

Add Your CV

Alternatively select from

View all jobs