Remote AI Jobs Canada

Overview

Remote AI jobs Canada on Rex.zone focus on practical AI/ML training workflows—data labeling, RLHF, prompt evaluation, and QA evaluation used to improve large language models and multimodal systems. You will help turn raw text, images, audio, and conversations into high-quality training data and structured evaluations for real production pipelines.

What You’ll Work On

* Training data quality checks for text, image, and multimodal datasets

* RLHF: ranking model outputs, preference labeling, rubric-based evaluation

* Prompt evaluation and response grading for helpfulness, correctness, and safety

* Named entity recognition (NER) and span-level annotation for NLP pipelines

* Computer vision annotation (bounding boxes, polygons, keypoints) plus QA review

* Content safety labeling for policy compliance and risk reduction

* Error analysis and reporting to improve guidelines and reduce rework

Responsibilities

* Follow annotation guidelines and document edge cases clearly

* Perform QA evaluation, resolve disagreements, and calibrate with reviewers

* Track labeling accuracy, throughput, and rework rates to protect data integrity

* Provide structured feedback on prompts, rubrics, and evaluation metrics

* Maintain privacy and security standards when handling sensitive content

* Contribute to continuous improvement for LLM training pipelines and evaluation sets

Required Qualifications

* 3+ years in AI data operations, data labeling, QA, or model evaluation

* Experience with RLHF-style preference data or prompt evaluation workflows

* Strong attention to detail and ability to apply rubrics consistently

* Comfort with ambiguous language tasks and iterative guideline updates

* Familiarity with NLP concepts (tokenization, entities, intent) or CV concepts (boxes, segmentation)

* Clear communication of findings to engineering and project leads

Nice to Have

* Experience with content safety labeling and policy-based evaluations

* Experience measuring inter-annotator agreement and improving calibration

* Exposure to production QA systems, audit sampling, and escalation workflows

Compensation

Competitive hourly rate: $30–$50/hour (USD), based on experience and project fit.