AI Training Jobs in Canada

About The Role

AI Training Jobs in Canada focus on building and evaluating AI/ML training data for LLM training pipelines. In this full-time remote role, you will label and evaluate text, image, and multimodal data to improve training data quality and model performance.

What You Will Do

* Perform data labeling for NLP, LLM, and computer vision annotation tasks

* Execute RLHF ranking and pairwise preference judgments

* Run QA evaluation checks and maintain annotation guidelines compliance

* Conduct prompt evaluation and response grading for helpfulness, correctness, and safety

* Apply content safety labeling (e.g., harassment, self-harm, adult content)

* Document edge cases, write clear rationales, and escalate ambiguous examples

* Collaborate asynchronously with cross-functional teams while following secure data handling practices

Required Qualifications

* Mid-Senior experience in AI/ML data operations, evaluation, or large-scale annotation programs

* Strong analytical writing and rubric-driven decision-making

* Familiarity with LLM training pipelines, dataset QA, and common annotation error sources

* Experience with NLP (classification, NER) and/or computer vision annotation workflows

* Ability to meet throughput targets and maintain high agreement rates in remote settings

Workflow and Tools

* Queue-based task routing with SLAs, audit trails, and spot audits

* Calibration sessions, gold-standard checks, and feedback loops

* Issue tracking for edge cases and guideline updates

* Privacy-first, secure remote work practices

Compensation

Hourly rate: $30–$50/hr (USD)