Senior Data Engineer

New York

  Data Engineering

Permanent

Our client is an exciting AI-driven startup that is embarking on a groundbreaking mission to transform cloud security management practices for security and DevOps teams. They are hiring a Senior Data Engineer to join their team in New York and lead the architecture and development of their data engineering initiatives.

Responsibilities: 

  • As the Senior Data Engineer, you will be responsible for crafting and constructing additional ETL pipelines to broaden core datasets.

  • You will imrpove the ontology supporting the company’s knowledge graph.

  • Utilize AI/ML methodologies to analyze exclusive infrastructure-as-code datasets.

  • Extract actionable insights to drive product decisions and strengthen their deterministic AI remediation engine.

  • Create reporting solutions to clarify business narratives for their clients

Skillset:

  • Minimum of five years of experience within data engineering and machine learning.

  • Proficient in applying algorithms and developing them, covering probabilistic analysis, machine learning and knowledge graphs.

  • Skilled in creating MLOps pipelines, employing tools like Apache Spark or Databricks.

  • Ability to extract insights and convey narratives from data.

  • Knowledgeable about BI tools for visualizing and reporting data.

  • Advanced expertise in Python for manipulating data, with familiarity in libraries such as Pandas.

  • Competent in SQL for querying data, connecting related datasets, and executing basic transformations and aggregation operations.

  • Experience in designing and analyzing experiments with tools like Jupyter notebooks.

Salary: Circa. $150k

Interested? Apply now in the link below or email your resume to kieran@alldus.com for consideration.

43525