QA Analyst

1. About Our Client:

The organization operates within the global healthcare sector, addressing complex challenges in health through an adaptive and innovative platform. It is structured by global practice areas and specialty agencies, offering a comprehensive suite of solutions to improve healthcare delivery and outcomes at scale.

2. About the Opportunity:

The QA Analyst is responsible for ensuring the quality, reliability, and trustworthiness of outcomes generated by an agentic AI platform. This role focuses on validating AI-generated outputs, multi-agent workflows, and lifecycle processes to ensure accuracy, explainability, compliance, and reproducibility. The position works closely with Product and Business Analysis teams to embed quality measures into the execution model, directly impacting the integrity and effectiveness of AI-driven healthcare solutions.

3. Responsibilities:

* Design and execute QA strategies for AI-generated artifacts, recommendations, and decisions

* Evaluate AI outputs for accuracy, relevance, completeness, hallucination risk, and context alignment

* Validate attribution, traceability, and reproducibility within execution and memory models

* Test end-to-end multi-agent workflows across lifecycle stages

* Ensure correct behavior across ad-hoc requests and structured deliverables

* Validate lifecycle state transitions, dependencies, and blocking logic

* Develop test cases for plan creation, execution phases, retries, halts, and re-runs

* Verify completeness and consistency of execution logs, artifacts, decisions, and audit events

* Test failure modes, edge cases, and recovery scenarios in agent execution

* Collaborate with Legal, Compliance, and Data teams for regulated workflow QA coverage

* Ensure AI outputs meet governance standards for explainability and decision rationaleA

* lign platform behavior with responsible AI standards, including bias awareness and data constraints

* Contribute to automated testing framework design for agentic systems

* Define and track quality metrics related to AI performance and user trust

* Provide feedback to Product and Engineering teams to improve agent behavior and orchestration

4. Requirements

* 4+ years experience in Quality Assurance, Test Engineering, or Product Quality roles on complex software platforms

* Hands-on experience testing AI-enabled, data-driven, or workflow-oriented systems

* Ability to validate probabilistic, non-deterministic outputs

* Strong knowledge of QA methodologies including functional, integration, regression, and UAT

* Experience designing test cases for LLMs, generative AI, or intelligent automation

* Capability to analyze agent behavior and output quality across multi-step workflows

* Familiarity with Agile environments and tools such as JIRA and Confluence

* Exceptional attention to detail with complex system states

Preferred: Experience with agentic AI frameworks or multi-agent workflows

Preferred: Background in regulated industries such as healthcare, life sciences, or financial services

Preferred: Exposure to LLM evaluation, prompt testing, AI benchmarking, audit logging, and responsible AI practices

5. Pay Range and Compensation Package:

* The pay range and compensation package for this role will be determined based on the candidate’s experience, skills, and other relevant factors.

6. Benefits &Perks

* Medical, dental, and 401(k) benefits

* Tuition reimbursement

* Flexible time off

* Flexible and remote work environment

7. Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.

Note: RemoteHunter is not the Employer of Record (EOR) for this role. Our purpose in this opportunity is to connect exceptional candidates with leading employers. We help job seekers worldwide discover roles that match their goals and guide them to complete their full application directly through the hiring company’s career pageor ATS.