Software Engineer – LLM Integration

New york, New York

Development - Back End

Permanent

Our client, a leading Health Insurance organization, is hiring a Software Engineer to join the team remotely. The successful candidate will work hand-in-hand with their product team to develop AI-driven features that transform how HR teams and employees engage with benefits and healthcare systems, while also equipping the company’s internal consulting teams with smarter, more efficient tools.

Responsibilities

Partner with Product, Engineering and Design teams to uncover challenges and craft generative AI solutions using best-in-class software engineering practices.
Integrate AI capabilities across the full stack (frontend, backend and infrastructure) seamlessly within their applications.
Develop intelligent search and retrieval systems that help users find the information they need, faster.
Design and optimise interactions with foundation models (GPT-4, Claude, Gemini) to deliver consistent and reliable results.
Deliver AI-powered features with the same high standards of reliability, scalability and performance as all applications.

Skillset

At least 5 years of experience building modern full-stack web applications using Python and JavaScript/TypeScript.
Hands-on experience integrating foundation models directly via APIs to create intelligent applications.
Proven ability to translate user needs into technical solutions while collaborating across cross-functional teams.
Comfortable working across frontend, backend and infrastructure layers.
Experience with advanced AI tools, including tool-calling, multi-agent systems and emerging AI capabilities.
Machine Learning background, with experience in PyTorch, scikit-learn, and deploying proprietary or open-source models.
Strong communicator capable of partnering effectively with non-technical stakeholders.