Senior Data Engineer

Senior Data Engineer II

We are currently recruiting a Senior Data Engineer to join an exciting technology company based in the Bay Area. Our client works within the Life Sciences industry with a large market of opportunities and are rapidly growing.

As a Senior Data Engineer, you will play a critical technical role within the company. The ideal candidate will be self-motivated and a team player using your experience to work with complex data.

Responsibilities:

• Work on different ETL/ELT frameworks within the company’s data platform while also creating new ones to improve the platform
• Engage in each stage of the engineering process from development to deployment to help data from ingestion to consumption
• Recommend and implement different ways to improve the data engineering process
• Identify different ways to resolve data quality/consistency problems
• Discover opportunities for data acquisition, diagnostics, mapping, and correction
• Integrate data pipeline with NLP/ML services

Technical Qualifications:

• B.S. in a highly quantitative field (e.g., Computer Science, Engineering, Physics, Mathematics, Operations Research, etc.) or equivalent experience (Advanced Degree preferred)
• 5+ years of data engineering or business intelligence experience
• At least 2+ years of developing data platform elements or creating complex data pipelines
• Proven experience working with different data engineering languages (Python & SQL)
• Experience working with different cloud data warehouses and similar databases (Databricks, Snowflake, MySQL, etc.)
• Understanding of AWS Cloud storage

Bonus:

• Experience with the stack within AWS (S3, Lambda, EMR, etc)
• Experience with event-driven architectures
• Experience building with ELK stack
• Experience with GRAPHQL or RESTAPI

If you are interested, please apply or send a resume to samuel@alldus.com