Machine Learning Engineer Jobs

Our client, an early-stage Facilities Management startup, is hiring a hands-on Head of Engineering to join their team in New York. The successful candidate will help define technical strategy and direction, while building the right systems and team to support the company as it scales.


Responsibilities

• Architect and own core, foundational AI and machine learning systems.

• Act as a strategic technical leader, shaping how AI is leveraged across the product and organization.

• Partner closely with founders and engineering leadership on long-term technical direction and key architectural decisions.

• Remain hands-on where necessary, particularly in the early stages, without operating permanently in an individual contributor role.

• Help define engineering standards, best practices and what “good” looks like as the company scales.

Skillset

• Early-stage startup experience is essential, such as a founding engineer, first AI hire or similar.

• Proven ability to wear many hats, combined with experience at a company that successfully scaled.

• Strong technical depth with clear fundamentals across AI and machine learning.

• Comfortable operating in ambiguous environments and building systems from zero.

Benefits

• Salary: $200k - $300k DOE.

Our client, a growing healthcare organization, is hiring a Product Manager to join their team in New York. The successful candidate will be responsible for shaping and delivering products that improve patient outcome, including taking full ownership of the product roadmap across the company’s core software platform and agentic workflows.


Responsibilities

• Own and deliver the product roadmap across the organization’s core platform and agentic workflows.

• Use structured prioritization frameworks to align business goals with client and patient needs.

• Drive the scaling of agentic systems to support increasing patient volumes and more complex interactions.

• Establish quality metrics, design experiments and continuously improve system performance.

• Lead market research and user discovery to identify unmet customer and patient needs.

• Prototype, test and validate new features quickly using an MVP-first approach.

• Act as the central liaison between technical teams (Engineering, Machine Learning) and business teams (Operations, Sales, Marketing).

• Translate product requirements into clear deliverables and ensure high-quality execution from ideation through launch.

Skillset

• At least 4 years of experience in product management roles.

• Minimum of 2 years delivering AI-native or agentic products into production.

• High-impact professional backgrounds in Investment Banking, Private Equity or Management Consulting will be considered.

• Demonstrated success scaling AI or data-driven products across growing user bases, data volumes and interaction complexity.

• Strong understanding of agentic system architectures and underlying technical principles.

• Proven ability to partner closely with engineering teams to build and scale complex data products.

• Strong analytical capabilities, including defining KPIs and using data to inform product decisions.

• Excellent communication skills, with ability to clearly explain complex technical concepts to non-technical stakeholders.

• Experience building and scaling products from 0 to 1 in fast-paced environments.

Benefits

• Salary: $160k - $185k

• Equity.

• Comprehensive health and dental benefits.

Staff MLOps Engineer
Remote

My client is a HealthTech startup helping individuals get healthier!
Sitting at the intersection of machine learning, infrastructure, and production systems. You'll get to build solutions across ML infra and MLOps that help drive velocity in Machine Learning to ship ML products quickly and safely.

You'll have autonomy and ownership to create, innovate and build solutions for the future of ML at the company creating huge impact.

You'll also get to build feature stores, test new MLOps tools, Optimize GPUs, inference and more. 


What else do you get? 

• Base Salary: 220-270k 

• Equity

• Fully Remote

What do you need to be successful? 

• Experience building solutions that drive ML product build velocity for the last 5+ years like ML Platform, ML Infra and MLOps. 

• Experienced with areas like real-time inferencing, GPU optimization, Feature store builds and over all ML lifecycle. 
• Worked with Cloud tools (GCP preferred or open to learning)

Interested in learning more? Apply or reach out to me at anthonyh@alldus.com

*Please note due to limited resources we are currently only shorlisting those who can work without visa support like Green Crad or Citizenship. 

Our client, a fast-growing AI startup, is hiring an AI/ML Engineer to join their team in New York. The successful candidate will focus on building the core Copilot product, with ownership across the full ML lifecycle - from data pipelines and model training to embeddings, retrieval, serving and continuous iteration in production.


Responsibilities

• Design, develop and deploy production-grade Machine Learning systems in Python, moving well beyond experimentation and notebooks.

• Take ownership of key components of the NLP and LLM stack, including embeddings, retrieval pipelines, RAG architectures and targeted fine-tuning.

• Build and iterate on recommendation and ranking models that surface who users should engage with and when.

• Work hands-on with vector databases and similarity search to drive relationship intelligence.

• Implement and maintain ML tooling for training, versioning, monitoring and evaluation.

• Collaborate closely with founders, product and engineering to translate ideas into shipped, measurable product capabilities.

• Integrate ML models into production APIs within a TypeScript / Nest.js–heavy environment.

• Continuously optimise latency, cost and performance, including model routing, caching, distillation and quantisation.

Skillset

• Minimum of 3 years of experience building and deploying production ML systems using Python, PyTorch or TensorFlow and scikit-learn.

• Hands-on NLP and LLM experience, including HuggingFace Transformers, embeddings, sentence-transformers and RAG architectures.

• Experience working with both proprietary models (e.g. OpenAI) and open-source LLMs (e.g. Llama, Mistral).

• Strong foundation in classical machine learning, including classification, ranking, supervised and unsupervised learning, and XGBoost or LightGBM.

• Experience with MLOps and infrastructure, such as experiment tracking, model versioning, Docker/Kubernetes, SageMaker or similar systems.

• Practical experience with vector databases, including Pinecone, Qdrant, Weaviate or comparable platforms.

• Strong software engineering fundamentals, with experience integrating ML models into reliable, production-grade systems.

Benefits

• Salary: Circa $250k.

• Equity.

• Health, dental and vision insurance.

Our client, an AI-driven organization within the Healthcare industry, is hiring a Staff Data Software Engineer to join their team in New York. The successful candidate will design, build and scale the data infrastructure that underpins agent improvement, clinical analytics and research collaboration. You will own streaming and batch pipelines to process agent conversations, clinical events and patient outcomes at scale.


Responsibilities

• Build and operate streaming and batch data pipelines on Databricks using Spark and Delta Lake.

• Design, implement and maintain CDC (Change Data Capture) pipelines that sync operational databases into Delta Lake.

• Develop data mining pipelines for persona discovery, scenario extraction and edge-case detection.

• Build and own the data backend for the Research Platform, including natural-language-to-SQL capabilities.

• Implement robust data quality checks, staleness detection and automated alerting.

• Develop pipelines for voice and SMS analytics, including call quality and engagement metrics.

• Support multi-region data deployments and compliance requirements.

• Collaborate closely with agent engineers and data scientists to surface insights that improve agent performance.

Skillset

• At least 4 years of experience in production data engineering roles.

• Deep, hands-on experience with Databricks, Spark and Delta Lake.

• Strong proficiency in Python and SQL for building and maintaining data pipelines.

• Experience designing and operating streaming pipelines and CDC (change data capture) systems.

• A solid understanding of data modelling, medallion architectures (bronze/silver/gold) and query optimisation.

• Experience implementing data quality frameworks, monitoring and alerting.

• A proven track record of delivering reliable, production-grade data infrastructure.

• Exposure to machine learning pipelines, including feature engineering and training infrastructure is desirable.

• Experience building natural-language query interfaces or LLM-powered data tools is a bonus.

• Experience working with healthcare data and familiarity with HIPAA compliance requirements is a plus.

Benefits

• Salary: $220k - $260k

• Health, dental and vision coverage.

• Mental Health and Wellness support.

Our client, a cutting-edge AI company revolutionizing software development, is hiring a Senior Software Engineer, AI Platform to join their team in New York. The successful candidate will contribute to designing and building the next-generation real-time layer for executing, deploying, governing and auditing AI applications, workflows and agents.


Responsibilities

• Develop, implement and fine-tune enterprise-level AI models and reliable production workflows.
• Create and maintain a real-time distributed execution engine that supports AI applications, agents and workflows.
• Design scalable and resilient systems that enable multi-tenant and hybrid cloud deployments, featuring secure APIs and a versatile integrations platform.
• Work closely with customers and design partners to collect feedback, validate approaches and guide product development.
• Collaborate with the product team to shape the roadmap and keep pace with the latest advancements in AI infrastructure.

Skillset

• At least 5 years of experience deploying and managing production applications in cloud environments.
• Extensive knowledge of containers, virtual machines, caches, task queues, networking and operating systems.
• Proven experience in building and running production AI systems.
• Familiarity with AI inference methodologies.
• Proficient with machine learning frameworks such as PyTorch and TensorFlow.
• Strong product intuition with a commitment to delivering smooth and intuitive user experiences.
• Strategic thinker who can anticipate market demands and develop effective technical solutions.
• Startup mindset - quick to act, comfortable with uncertainty, and passionate about turning ideas into delivered products.

Benefits

• Salary: $170K - $210k
• Equity
• Remote working within the U.S.

Our client, a fast-growing healthcare organization, are hiring a Machine Learning Engineer to join the team in New York or San Francisco. The successful candidate will play a key role in shaping the future of conversational AI by driving meaningful improvements in patient outcomes and transforming the way healthcare systems engage and communicate.


Responsibilities

• Develop and implement machine learning models tailored for SMS and voice-enabled conversational AI.

• Create scalable pipelines to support data ingestion, model training and real-time deployment.

• Fine-tune large language models using healthcare-focused datasets to enhance accuracy and relevance.

• Collaborate with full-stack engineering teams to seamlessly integrate AI capabilities into core product experiences.

• Lead the full lifecycle of model deployment, including monitoring, troubleshooting and iterative optimization.

• Continuously explore emerging AI/ML technologies and healthcare innovations to keep their solutions cutting-edge.

 

Skillset

• At least 4 years of experience in AI/ML engineering, with a strong focus on NLP, large language models and conversational AI.

• Proven track record of deploying ML models into production, preferably within healthcare or other regulated industries.

• Proficient in Python and experienced with ML frameworks such as TensorFlow and PyTorch.

• Strong skills in fine-tuning LLMs, prompt engineering and integrating models into real-world applications.

• Comfortable working with cloud platforms (e.g. AWS, Azure, GCP) and knowledgeable in MLOps practices for scalable deployments.

• Experience with voice and speech-based technologies, including recognition and generation.

• Hands-on background in designing and implementing conversational AI solutions.

• Exceptional analytical and communication abilities.

• Familiarity with HIPAA compliance and handling of sensitive healthcare data is a bonus.

Benefits

• Competitive Salary.

• Equity.

• Remote working.

• Comprehensive healthcare package.

Our client, an AI-driven healthcare organization, is hiring a Software Engineer with expertise in Backend Engineering and Machine Learning to join their team in New York. The successful candidate will design and build scalable backend systems and machine learning infrastructure, which will support real-time patient engagement, seamless integration of complex data sources and measurable improvements in healthcare outcomes.


Responsibilities

• Design, build and maintain scalable backend services and APIs that power an AI-driven patient engagement platform.

• Develop and operate production-grade infrastructure for deploying, monitoring and scaling LLM-based applications.

• Collaborate with AI/ML engineers to embed conversational AI and predictive models into core platform workflows.

• Architect flexible, extensible backend systems that scale with expanding product capabilities and data demands.

• Implement and maintain CI/CD pipelines, including automated testing, versioning and deployment processes.

• Develop reusable libraries, frameworks, and components to accelerate development and enhance code quality.

• Promote engineering best practices to ensure systems are secure, scalable, and maintainable.

• Utilize cloud platforms (GCP, Azure, AWS) to deliver reliable and cost-efficient infrastructure for web services and ML workloads.

Skillset

• Minimum 5  years of full-stack development experience, including at least 2 years in a senior-level role.

• Proven track record of taking products from 0 ? 1 and scaling from 1 ? N in early-stage environments.

• Strong proficiency in Node.js and/or Python, relational databases, ReactJS and Express.

• Demonstrated interest in AI, with hands-on experience integrating LLMs into production systems.

• Excellent system design and architecture skills, with a focus on scalability and extensibility.

• Disciplined engineering approach, adhering to Clean Code principles, TDD, and CI/CD practices.

• Experience collaborating with cross-functional and non-technical stakeholders.

• Portfolio of projects showcasing leadership or ownership of significant engineering initiatives.

Benefits

• Salary: $150k - $180k DOE.

Our client, a leading Health Insurance organization, is hiring a Software Engineer to join the team remotely. The successful candidate will work hand-in-hand with their product team to develop AI-driven features that transform how HR teams and employees engage with benefits and healthcare systems, while also equipping the company’s internal consulting teams with smarter, more efficient tools.


Responsibilities

• Partner with Product, Engineering and Design teams to uncover challenges and craft generative AI solutions using best-in-class software engineering practices.

• Integrate AI capabilities across the full stack (frontend, backend and infrastructure) seamlessly within their applications.

• Develop intelligent search and retrieval systems that help users find the information they need, faster.

• Design and optimise interactions with foundation models (GPT-4, Claude, Gemini) to deliver consistent and reliable results.

• Deliver AI-powered features with the same high standards of reliability, scalability and performance as all applications.

Skillset

• At least 5 years of experience building modern full-stack web applications using Python and JavaScript/TypeScript.

• Hands-on experience integrating foundation models directly via APIs to create intelligent applications.

• Proven ability to translate user needs into technical solutions while collaborating across cross-functional teams.

• Comfortable working across frontend, backend and infrastructure layers.

• Experience with advanced AI tools, including tool-calling, multi-agent systems and emerging AI capabilities.

• Machine Learning background, with experience in PyTorch, scikit-learn, and deploying proprietary or open-source models.

• Strong communicator capable of partnering effectively with non-technical stakeholders.

Benefits

• Salary: $150k - $200k DOE

• Stock options.

• Health, Dental and Vision insurance.

• Remote working.

Our client, an AI-driven organization in the Fintech industry, are hiring a Staff Machine Learning Engineer to join the team in Colorado. The successful candidate will will focus on building end-to-end generative AI products leveraging your deep expertise in large language models, fine-tuning techniques and reinforcement learning.


Responsibilities

• Design and build multi-agent systems that automate tasks and streamline workflows, delivering measurable operational impact.

• Develop AI co-pilots for advisors and other user personas, supporting workflows across prospecting, conversion, onboarding and client servicing.

• Create purpose-built, low-latency models for complex, multi-turn financial services interactions.

• Enable AI-driven optimisation and navigation of legacy platforms using computer-use and automation models.

• Design, fine-tune, and deploy open-source and proprietary LLMs for use cases including Q&A, summarisation, reasoning and planning.

• Build advanced Retrieval-Augmented Generation (RAG) pipelines, incorporating query rewriting, embedding fine-tuning, hybrid search, re-ranking and knowledge graphs.

• Apply reinforcement learning techniques, including RL fine-tuning methods such as PPO, DPO, and GRPO, to continuously improve model performance.

• Deploy models to production, ensuring high performance, reliability, scalability and low latency.

Skillset

• At least 5 years of experience in applied AI/ML engineering.

• Demonstrated success delivering production-grade generative AI products with large language models at their core.

• Hands-on experience with LLM fine-tuning techniques (e.g. LoRA), inference frameworks (e.g. vLLM) and advanced Retrieval-Augmented Generation (RAG) architectures.

• Strong practical expertise in reinforcement learning fine-tuning methods and supporting tooling.

• Previous experience working in an early-stage startup is a plus.

Benefits

• Salary: $170k - $220k DOE

Our client, a FinTech innovator, are hiring a Staff Machine Learning Engineer with expertise in Large Language Models (LLMs) to join the team remotely. The successful candidate will be responsible for building Generative AI and LLMs solutions in a in a fast paced environment that will help transform financial advice delivery.


Responsibilities

• Lead the development and customization of large language models tailored for financial use cases.

• Apply cutting-edge tuning methodologies to enhance performance across conversational AI, content generation and strategic reasoning tasks.

• Create intelligent retrieval systems that combine multiple search approaches, semantic understanding and ranking mechanisms to deliver contextually relevant information at scale.

• Engineer autonomous AI systems capable of independent decision-making, integrating feedback loops and adaptive learning techniques to continuously enhance agent capabilities.

• Establish comprehensive testing and monitoring frameworks while overseeing production deployments that maintain high-performance standards under real-world conditions.

• Work closely with cross-functional teams to transform AI research into market-ready features that solve genuine business challenges.

Skillset

• Minimum 5 years of professional experience applying machine learning in commercial settings post-graduation.

• Must have at least 2 years’ experience working with LLMs and finetuning like QLORA / LORA and building RAG systems.

• Demonstrable success delivering end to end ML /AI products where generative AI drives core functionality, with particular emphasis on systems that exhibit autonomous behavior patterns.

Benefits

• Salary: $190,000 - $225,000 .

• Equity.

• Comprehensive health/dental/vision coverage.

• Retirement plans.

If interested hit apply below or reach out to me at joseph.mcdermott@alldus.com

Staff Machine Learning Engineer
Location: Remote

Are you tired of being kept in a restricted creative box with limited autonomy to push boundaries and ideas to solve problems with ML? 

Or not seeing your work directly impact the companies mission? 

If so , my HealthTech client is looking for a Staff ML Engineer who will love being in an autonomous environment where you will be given a problem area but full autonomy to be creative, push new ideas and build the ML solutions you feel is best. 

You'll join a smart and curious team who like to be challenged working on areas like Recommender Systems, LLMs & NLP, Timeseries and MLOps.

You'll achieve success here by combining your technical ML/AI end-to-end building skills with high positive energy and clear articulate communication skills. 

What else is in it for you? 

• Base Salary from 210-260k 
• Equity/Stocks

What do you need to be successful? 

• Are a technical leader who can work and manage their own projects and solutions with full autonomy. Like a Staff/ Principal ML Engineer / Scientist
• You can clearly articulate your thoughts and write and communicate them clearly.
• Build ML/AI solutions end to end in the ML Lifecycle from research to production
• Comfortable with being challenged and taking feedback to build better solutions with the right outcomes
• Can move with speed and intent and comfortable with life building a startup/scaleup

Interested? Click the apply or For more info reach out at anthonyh@alldus.com