AI Infrastructure Lead Jobs

Our client, a leading innovator in Insurance industry, are hiring an AI Engineer to join their growing team in New York. The successful candidate will play a key role in executing the company’s AI strategy, along with designing, building and integrating intelligent, reliable and scalable AI-driven features into their core applications using modern web frameworks and cloud infrastructure.


Responsibilities

• Partner with product, engineering and design teams to uncover user challenges and deliver generative AI solutions using modern software development practices.

• Build end-to-end AI integrations across the full stack - frontend, backend and infrastructure - embedding intelligence directly into applications.

• Create smart search and information retrieval systems that enable users to access relevant data quickly and efficiently.

• Design and implement robust interactions with foundation models (e.g. GPT-4, Claude, Gemini) to ensure reliable and consistent performance.

• Deliver AI-powered features that uphold the highest standards of scalability, security and performance.

Skillset

• Minimum of 5 years of experience building modern full-stack web applications with Python and JavaScript/TypeScript.

• Practical experience integrating foundation models via direct API connections.

• Demonstrated ability to translate user challenges into elegant technical solutions and lead initiatives that deliver engaging AI experiences.

• Proficient across the full application stack, from frontend to backend and infrastructure.

• Knowledge of tool calling, multi-agent systems, and emerging frameworks such as Model Context Protocol (MCPs).

• Hands-on experience with Machine Learning (PyTorch, scikit-learn) and deploying proprietary or open-source models.

• Strong communication skills with a proven ability to collaborate effectively with cross-functional teams.

Benefits

• Salary: $170k - $200k

• Stock options.

• Healthcare, vision and dental insurance.

Our client, a venture-backed AI SaaS startup, are hiring a Senior AI/ML Engineer to join their product team in New York. The successful candidate will have the opportunity to tackle greenfield challenges and build core systems from the ground up.


Responsibilities

• Take ownership of the AI stack,  including selecting models, vector stores and cloud infrastructure to build a secure, high-performance pipeline.

• Manage the full AI workflow, including data ingestion, cleaning, training, evaluation, deployment, monitoring and fine-tuning.

• Operationalize AI by implementing CI/CD for models and data, ensuring reproducible experiments, monitoring for drift and maintaining usage dashboards.

• Optimize systems for enterprise requirements, balancing latency, cost, data privacy and compliance-friendly logging.

• Collaborate closely with product and engineering leadership to prioritize and execute high-impact initiatives.

• Make pragmatic technical decisions in ambiguous environments, balancing technical elegance with business needs.

• Help shape the engineering culture, tooling and processes in a fast-growing, early-stage startup.

Skillset

• Over 7 years of professional experience, including 5 years developing clean, production-ready code for distributed, cloud-native systems.

• At least 2 years of hands-on experience deploying LLM pipelines in production, with strong knowledge of tokenization, context windows, sampling strategies and common failure modes.

• Proven track record in shipping generative AI or NLP products that meet real-world constraints such as latency, cost and data privacy.

• Deep expertise in LLM tuning and retrieval, including prompting, RAG, embeddings, fine-tuning and hallucination mitigation.

• Strong expertise of broader ML/data science experience, transforming raw data into robust models.

• Experience in ML Ops, including CI/CD for models, experiment tracking, and production monitoring.

• Strong product instincts, able to prototype quickly, iterate and collaborate closely with domain experts.

• Demonstrated technical leadership through setting engineering standards, writing clear documentation and mentoring team members.

• Proficiency with ML/LLM tools and libraries, with the ability to explain complex code and system behavior clearly.

Benefits

• Salary: $160k - $220k DOE.

• Equity.

Our client, a fast-growing AdTech organization, is hiring a Machine Learning Engineer/Tech Lead to join their team in California. The successful candidate will build and scale advanced systems for prediction, recommendation and generative AI, as well be responsible for solving complex, large-scale machine learning challenges and delivering cutting-edge solutions.


Responsibilities

• Design, train and deploy ML models and large-scale systems for prediction, recommendation and content generation.

• Tackle advanced use cases including CTR/CVR prediction, ranking, fraud detection and cutting-edge generative methods (LLMs, transformers, diffusion models).

• Develop scalable algorithms combining deep learning, regression and hybrid rule-based techniques.

• Diagnose and resolve performance bottlenecks across infrastructure, tools and pipelines.

• Rapidly prototype, experiment and iterate on models using massive, real-world datasets.

• Guide and mentor junior engineers, and lead small technical projects when required.

• Leverage distributed computing and GPU environments to optimize model training and deployment.

Skillset

• Master’s or Bachelor’s degree in Computer Science, Engineering, Applied Sciences, Mathematics or similar.

• At least four years of experience in software engineering or applied Machine Learning.

• Proven record of building and deploying large-scale ML systems in production.

• Experience driving technical direction, mentoring teams or leading cross-functional projects.

• Strong foundation in algorithms, data structures and ML fundamentals.

Benefits

• Competitive compensation.

• Comprehensive benefits package.

Our client, an exciting Healthtech organization, are hiring a Full Stack Engineer to join the team in New York. The successful candidate will work closely with the CTO and partner with product, operations and clinical teams to design the backend systems and ML infrastructure that enable real-time patient engagement, helping to lay the foundation of the platform in a fast-paced,  high-growth startup environment.


Responsibilities

• Develop and maintain scalable backend services and APIs powering the company’s AI-driven platform.

• Design and deploy infrastructure to support LLM-based applications in production environments.

• Partner with AI/ML engineers to embed conversational AI and predictive models into the platform.

• Lead the architecture of extensible backend systems that evolve with product growth and increasing data demands.

• Establish and manage CI/CD pipelines, automated testing and deployment workflows.

• Create reusable libraries, components, and frameworks to streamline development.

• Champion engineering best practices to ensure secure, scalable, and maintainable code.

• Utilize cloud platforms (GCP, Azure, AWS) to build cost-effective, high-performance infrastructure.

Skillset

• At least 5 years of full stack development experience, including two years in a senior engineering role.

• Strong proficiency in Node.js, Python, RDBMS, ReactJS and Express.

• Expertise in system architecture with a track record of designing scalable backend solutions.

• Practical experience integrating LLMs into production systems or strong motivation to gain this expertise.

• Rigorous engineering discipline with emphasis on Clean Code, TDD and CI/CD.

• Familiarity with DevOps practices, containerization (Docker), and orchestration (Kubernetes).

• Experience with AI model deployment, monitoring, and A/B testing.

• Excellent communication and collaboration skills across cross-functional teams.

• Demonstrated leadership through projects where you drove engineering efforts.

• Background in healthcare technology or other regulated industries is a bonus.

Benefits

• Salary: $160,000 - $175,000.

• Comprehensive Benefits Package.

Our client, a growing AI-driven startup, is hiring a a Staff Platform Engineer to join the team in California. The successful candidate will design and scale their core infrastructure, driving projects that improve system reliability, boost developer efficiency and elevate operational standards within their talented engineering team.


Responsibilities

• Design and build scalable backend systems that support complex data labeling workflows, enable real-time collaboration, and incorporate large language model (LLM) capabilities.

• Lead infrastructure initiatives focused on deployment, observability and performance optimization within a cloud-native environment.

• Develop secure, modular APIs and services that seamlessly integrate with both internal tools and customer-facing applications.

• Work closely with engineers, product managers and data operations teams to advance the company’s platform features and capabilities.

• Establish and maintain observability best practices - including logging, metrics, tracing and health monitoring - to deliver an exceptional developer experience.

• Guide architectural decisions involving service decomposition, asynchronous processing, scaling strategies and high-availability systems.

• Take ownership of the reliability and performance of critical services, including distributed task routing, model integrations and data pipelines.

• Mentor engineering team members in creating scalable, maintainable systems using contemporary engineering best practices.

Skillset

• Minimum of 8 years’ experience in backend or platform engineering, preferably within fast-growing SaaS or AI infrastructure companies.

• Proficient in Python programming, with hands-on experience using frameworks such as FastAPI.

• Strong expertise in cloud platforms (AWS, GCP or Azure), including container orchestration technologies like Docker and Kubernetes, and Infrastructure as Code tools such as Terraform.

• Experienced with SQL databases (e.g. PostgreSQL) and event-driven messaging systems (e.g. Kafka, RabbitMQ, Redis Streams).

• Well-versed in CI/CD pipelines, automated testing and deployment methodologies for large-scale production environments.

• Demonstrated ability to troubleshoot complex distributed systems, identify performance bottlenecks and build robust, resilient architectures.

• Comfortable working in early-stage, dynamic environments, taking initiative to identify and solve high-impact challenges.

• Experience integrating large language models (LLMs), working with ML/AI infrastructure or contributing to data labeling platforms is a plus.

• Design and build scalable, maintainable platform systems from the ground up.
• Develop robust backend services and APIs mainly with Python and using Rust for performance-critical components.
• Work closely with frontend teams on integrations using JavaScript and TypeScript.
• Automate infrastructure deployment using modern DevOps tools and Infrastructure as Code practices.
• Provide technical leadership by establishing best practices and guiding architectural decisions.
• Own features end-to-end, from initial concept through to production release.

• Proven experience in software development, with strong Python backend skills.
• Demonstrated success building systems from the ground up in fast-paced environments.
• Proficiency in JavaScript/TypeScript and modern frontend frameworks.
• Experience with Rust, or a willingness to learn it for performance-critical tasks.
• Hands-on familiarity with cloud platforms such as AWS, GCP or Azure.
• Experience with containerization using Docker and orchestration with Kubernetes.
• Strong system design skills, including designing clean APIs and scalable architectures.
• A DevOps mindset, with expertise in CI/CD pipelines, monitoring and observability.
• Excellent communication and teamwork skills.
• Passion for open-source and active contribution to community-driven projects.

• Salary: $100K - $220K DOE.
• Equity.
• Comprehensive health, dental and vision insurance.

• Architect, maintain and scale high-performance computing (HPC) and storage solutions across both on-premises and cloud environments.
• Collaborate with global teams to diagnose and resolve infrastructure challenges across operating systems, storage and networking.
• Champion innovation by exploring and implementing emerging technologies to enhance research infrastructure.
• Oversee and optimise a range of compute resources, including CPUs, GPUs and other specialised processing units.
• Work closely with software engineers to deliver seamless, high-performance platforms that power advanced research initiatives.

• Minimum of 5 years of experience in data engineering.
• Strong, hands-on experience with Databricks, especially in a production environment
• Solid expertise in Linux-based systems and environments.
• Hands-on experience with Infrastructure as Code tools, such as Ansible and Terraform.
• Working knowledge of cloud platforms like AWS, GCP or Azure.
• Genuine interest in high-performance computing and solving complex system-level challenges.
• Proven ability to diagnose and resolve issues across various layers of infrastructure.
• Effective communicator and team player, comfortable working in cross-functional and globally distributed teams.

• Salary: $250k - $300k.
• Performance Bonus.
• 401(k) matching up to 50%.
• Health, dental, vision, mental health, disability and life insurance.

Our client, an exciting AI-driven company, are hiring a Software Engineer to join the team in New York. The successful candidate will take a lead role in designing and developing advanced human-AI interaction systems, offering a unique opportunity to influence how humans and AI collaborate efficiently at scale.


Responsibilities

• Build intuitive user interfaces and powerful backend systems that enable meaningful human oversight and continuous AI learning, ensuring their AI adapts seamlessly to human expectations.

• Develop intelligent feedback loops to improve AI output quality, reliability and security.

• Collaborate with product, research and leadership teams to translate human expertise into effective AI correction mechanisms.

• Implement robust backend infrastructure to support continuous AI model monitoring and adaptation.

• Optimize performance and reliability for enterprise-scale AI deployments.

• Ensure compliance with relevant regulatory and security standards.

• Participate in technical strategy discussions and contribute to shaping product direction.

• Mentor and collaborate with future team members as the company grows.

Skillset

• Previous experience working at leading tech organizations developing AI-driven products.

• Demonstrated success in deploying and managing Large Language Models or generative AI systems at scale.

• Familiarity with AI applications in regulated or high-security settings.

• Strong expertise in optimizing enterprise-level systems for reliability, scalability and performance.

• Understanding of compliance frameworks such as SOC 2, GDPR or equivalent standards.

• Previous startup experience, particularly within early-stage deep tech environments.

Salary: $160-$180k


Interested? Apply now in the link below.