QA Tester

Our client, a leading Life Sciences organization, are hiring a QA Tester to join their team in Dublin, Ireland on a contract basis. The successful candidate will play a vital part in ensuring the quality and performance of their multi-agent LLM product across a variety of business-critical applications.

Responsibilities

• Design and execute comprehensive test plans for the company’s AI Assistant’s front-end UI and conversational interfaces.

• Conduct manual and automated testing to validate functionality, usability and performance.

• Validate LLM-generated responses against structured and unstructured data to ensure accuracy and reliability.

• Identify and document hallucinations, gaps in logic and inconsistencies in AI outputs.

• Develop and maintain answer validation frameworks and quality benchmarks for Generative AI.

• Build and optimise UI automation and performance testing scripts.

• Track defects, test outcomes and progress using Jira, ensuring clear documentation and resolution follow-up.

• Collaborate with developers and product teams to troubleshoot and reproduce issues efficiently.

• Continuously improve testing frameworks and processes for better coverage and scalability.

• Participate in agile ceremonies (stand-ups, sprint planning, retrospectives) and contribute to release readiness.

Skillset

• Demonstrated expertise in both manual and automated software testing methodologies.

• Practical experience testing Generative AI systems, LLM-powered applications or conversational chatbots.

• Strong grasp of UI testing principles, as well as functional, regression and exploratory testing techniques.

• Working knowledge of LLMs, natural language processing models, and AI output validation.

• Proficiency with industry-standard tools such as Katalon Studio, Selenium, Postman or equivalent.

• Keen eye for detail with the ability to detect hallucinations, logic gaps and inaccuracies in AI-generated content.

• Analytical and systematic problem-solver, capable of troubleshooting complex issues with a data-informed approach.

• Clear and effective communicator, skilled in documenting findings and collaborating across technical and non-technical teams.

53731