Software Engineer – AI Testing Analyst

About The Role

We're seeking experienced software engineers in Toronto to evaluate and improve the performance of frontier AI models. You'll critically assess AI-generated code, identify subtle bugs and hallucinations, and provide expert-level feedback.

* Organization: Alignerr

* Type: Hourly Contract

* Compensation: $50–$100 /hour

* Location: Remote

* Commitment: 10–40 hours/week

What You'll Do

* Evaluate the performance of frontier language models on complex software engineering tasks

* Identify bugs, logical errors, hallucinations, and reliability issues in model outputs

* Design and review prompts, test cases, and evaluation scenarios for advanced coding workflows

* Provide precise written feedback explaining model strengths, weaknesses, and edge cases

* Work across multiple languages and codebases to assess generalization and correctness

Who You Are

* 3–4+ years of professional software engineering experience

* Strong proficiency in at least one of: TypeScript, Ruby, Java, or C++

* Excellent written and spoken English

* Demonstrated ability to reason about complex systems and debug non-obvious issues

* Familiarity with modern AI / LLM tooling (Git, CLI workflows, testing frameworks, etc.)

* Ability to critically evaluate model behavior rather than simply use model outputs

Why Join Us

* Competitive pay and flexible remote work

* Work on cutting-edge AI projects with top research labs

* Freelance perks: autonomy, flexibility, and global collaboration

* Potential for ongoing work and contract extension

Application Process (Takes 10–15 min)

* Submit your resume

* Complete a short screening

* Project matching and onboarding

PS: Our team reviews applications daily. Please complete your application steps to be considered for this opportunity.