Location: Berlin, Germany
Industry: Food Delivery
Opportunity for a Senior Data Scientist to join a company and help them to build a Machine Learning Lab team that is being built from scratch.
After checking the data of every team, the conclusion has found out that the quality of data is the restriction from making this happen.
Now they have created a Big Data Lake. The plan is for the Data Lake to function like IBM’s Watsons and be the all in one place for data gathering and processing. Next steps after this? introduce microservices to the Data Lake.
The overall goal of the machine learning lab is to help the company become a Data Driven organisation like Netflix.
Day to Day tasks:
- Designing, implementing and maintaining batch, near-time and real-time data processing pipelines and analytical workflows.
- ETL and data sync processes for cleaning and structuring data.
- Extracting data from various 3rd party tools and APIs.
- Proactively make suggestions on how the team can leverage new technologies and architectures to improve the performance of our data platform.
Core tech stack:
Python (Primary), AWS, SQL, ETL, Apache (Spark and Kafka), DevOps Tools (Docker, Cloud Formation)
If you would like to find out more information about this opportunity, please email me back on Anthony@Alldus.com
Join the Alldus AI in Action Berlin Meetup: https://www.meetup.com/AI-in-Action-Berlin/
Listen into the Alldus AI in Action Podcast: https://alldus.com/blog/podcasts/
Complete the form below to apply for the Data Engineer role: