Specialist - Quality Engineering

Role description

GEN AI Tester

Key Responsibilities:

Functional Model Testing

Design and execute test cases for AIML models including classification NLP recommendation and generative AI systems

Validate model outputs for accuracy consistency and expected behavior across diverse inputs

Perform regression testing after model updates retraining cycles or data changes

Prompt LLM Testing

Develop and maintain prompt test libraries for large language model LLMbased features

Evaluate model responses for relevance tone factual accuracy and adherence to business rules

Identify hallucinations response drift and edgecase failures in generative outputs

AI Safety Red Teaming

Conduct adversarial testing to identify vulnerabilities such as prompt injection jailbreaks and unintended model behaviors

Assess outputs for bias fairness and compliance with responsible AI principles

Document risk findings and collaborate with model teams to drive remediation

Test Automation Tooling

Build and maintain automated test suites for AI pipelines using Pythonbased frameworks

Integrate AI testing into CICD workflows and contribute to evaluation infrastructure

Track and report quality metrics model performance benchmarks and defect trends

Collaboration Documentation

Partner with data scientists ML engineers and product teams throughout the development lifecycle

Write clear test plans defect reports and evaluation summaries

Contribute to internal QA standards and best practices for AI systems

Other details

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree Canada (“LTIMC”):

Benefits and Perks:

* Comprehensive Medical Plan Covering Medical, Dental, Vision

* Health Care Spending Account

* Short Term and Long-Term Disability Coverage

* Life Insurance

* Annual vacation and other Paid Leaves

* Maternity Leave Top Up Pay

The range displayed on each job posting reflects the total compensation range for the position across all Canada locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.

Accessibility and Reasonable Accommodation:

LTIMindtree has an accommodation process in place and provides accommodations for applicants with disabilities. If you require a specific accommodation because of a disability or a medical need, please write to us at so that arrangements can be made for the appropriate accommodations to be in place.