Senior AI Engineer

New York

Machine Learning

Permanent

Our client, an AI-driven FinTech organization, are hiring a Senior AI Engineer to join the team in Manhattan, New York. The successful candidate will work with LLMs and deploy real-world AI agents, focusing on orchestration, evaluation and reliability to ensure agents perform meaningful work safely, efficiently and consistently.

Responsibilities

Design, build and productionize end-to-end agent workflows, including APIs, tools, evaluation frameworks, monitoring and multi-step processes.
Optimize system performance by managing latency, cost and safety controls, and building dashboards and alerts for reliability.
Evaluate and compare models, hosting solutions and prompt strategies, implementing guardrails as needed.
Measure outcomes, run A/B tests and iterate to improve task success and overall system effectiveness.
Collaborate with product and design teams to develop and ship innovative interaction patterns.

Skillset

At least 3 years of experience building AI/ML systems, preferably with LLMs or agentic workflows.
Strong programming skills in Python, including libraries like NumPy, PyTorch or TensorFlow.
Experience designing and integrating APIs, microservices and evaluation frameworks.
Knowledge of workflow orchestration, multi-step planning and memory/retrieval systems.
Familiarity with cloud platforms (AWS, GCP, Azure) and containerized environments (Docker, Kubernetes).
Strong problem-solving skills with the ability to make informed system and code-level decisions.
Experience with monitoring, instrumentation and A/B testing to optimize outcomes.
Excellent collaboration and communication skills.