AI Quality Analyst (Japanese)

Job Description

Job Title: AI Quality Analyst

Location: Boston, MA

* Remote

Placement Type: Temporary

Salary: $20 Hourly

Start Date: April 6, 2026

Responsibilities

* Design and execute conversational prompts requiring AI to utilize personal information.

* Evaluate AI model responses for appropriate personalization.

* Analyze responses for 'Grounding' issues.

* Assess 'Integration' quality of personal data in responses.

* Compare and rank AI model responses side-by-side.

* Write clear rationales for response comparisons.

* Extract and verify "Debug Info" from the model.

* Maintain data hygiene by deleting evaluation conversations.

Must-Have Qualifications

* Japanese Proficiency (reading and writing with high comprehension).

* Exceptional Analytical Thinking.

* Creative Prompt Engineering experience.

* Strong Evaluation Acumen (understanding personalization concepts).

* Meticulous Attention to Detail.

* Excellent Written Communication.

* Ability to provide constructive feedback and detailed annotations.

* Excellent communication and collaboration skills.

* Self-motivated and able to work independently in a remote setting.

* Desktop/Laptop with a good internet connection.

* BS/BA degree or equivalent experience in a relevant field.

* Willingness to use primary personal account and enable personal data sources.

* Full-time availability (8 hours per day) and 4 hours overlap with a specific time zone.

* Schedule Flexibility.

Nice-to-Have Qualifications

* Experience in data annotation, AI quality evaluation, content moderation, or a related role.

Offer Details

* Engagement Type: Contractor (1 month)

* Commitment: At least 4 hours per day and a minimum of 30 hours per week, with 4 hours of overlap with a specific time zone. (Options: 30 hrs/week or 40 hrs/week)

* Compensation: $20/Hr Per Hour