Senior Software Engineer, AI Platform

New York

Development - Java Backend

Permanent

Our client, a cutting-edge AI company revolutionizing software development, is hiring a Senior Software Engineer, AI Platform to join their team in New York. The successful candidate will contribute to designing and building the next-generation real-time layer for executing, deploying, governing and auditing AI applications, workflows and agents.

Responsibilities

Develop, implement and fine-tune enterprise-level AI models and reliable production workflows.
Create and maintain a real-time distributed execution engine that supports AI applications, agents and workflows.
Design scalable and resilient systems that enable multi-tenant and hybrid cloud deployments, featuring secure APIs and a versatile integrations platform.
Work closely with customers and design partners to collect feedback, validate approaches and guide product development.
Collaborate with the product team to shape the roadmap and keep pace with the latest advancements in AI infrastructure.

Skillset

At least 5 years of experience deploying and managing production applications in cloud environments.
Extensive knowledge of containers, virtual machines, caches, task queues, networking and operating systems.
Proven experience in building and running production AI systems.
Familiarity with AI inference methodologies.
Proficient with machine learning frameworks such as PyTorch and TensorFlow.
Strong product intuition with a commitment to delivering smooth and intuitive user experiences.
Strategic thinker who can anticipate market demands and develop effective technical solutions.
Startup mindset – quick to act, comfortable with uncertainty, and passionate about turning ideas into delivered products.