AI Jobs in Canada
Rex.zoneFull Description
AI Jobs in Canada (Remote, Full-Time) — Open Role
Rex.zone supports distributed AI/ML data operations that improve large language model evaluation and training data quality. This role focuses on production-grade workflows such as RLHF, data labeling, prompt evaluation, QA evaluation, and content safety labeling across NLP and (optionally) computer vision.
What You Will Do
* Execute RLHF evaluation, preference ranking, and rubric-based rationales
* Perform prompt evaluation and response grading (helpfulness/harmlessness/honesty)
* Complete data labeling tasks including named entity recognition and text classification
* Run QA evaluation via audits, spot checks, and inter-annotator agreement workflows
* Apply content safety labeling policies and maintain annotation guidelines compliance
* Document edge cases and surface systematic failure modes impacting LLM training pipelines
Required Qualifications
* Mid-Senior experience in AI data operations or applied ML support
* Strong written reasoning and comfort with rubric-based evaluation
* Familiarity with RLHF concepts and large language model evaluation
* Experience with labeling taxonomies (classification, NER, evaluation tasks)
* Comfort using web-based annotation tools, task queues, and spreadsheets
How To Apply
Apply via Rex.zone and include a brief summary of your RLHF evaluation, data labeling, prompt evaluation, or QA evaluation experience, plus any examples of improving training data quality or clarifying annotation guidelines.