Back to jobs

UI / UX Design Expert

Weekday (YC W21)
Remote (United States)Contract

Upload your resume once and Scout applies for you

Apply with Scout
Share this job:LinkedInXSave image

Full description

This role is for one of our clients

Compensation: $80-$150 per hour

1. Role Overview

We are seeking experienced UI/UX and product design professionals to contribute to an AI research initiative focused on evaluating how effectively AI systems perform real-world digital product design work. In this role, you will help define what high-quality product and UX work looks like by developing task-specific evaluation criteria and assessing completed work samples with rigorous, well-reasoned written feedback.

The ideal candidate brings hands-on experience designing digital products, strong knowledge of modern UX practices, and the ability to distinguish thoughtful, production-ready design from superficial or incomplete work.

Requirements

2. Key Responsibilities

• Develop clear, objective, task-specific grading criteria for digital product and UX deliverables, including:

• Design systems and component libraries

• Responsive interfaces, dashboards, and web applications

• End-to-end product journeys such as onboarding, checkout, booking, and account management

• Customer portals and logged-in experiences

• UX writing and product content

• Design-to-development and production handoff

• Evaluate AI-generated and human-created design work against established criteria.

• Provide detailed, evidence-based written explanations for each evaluation, clearly identifying strengths, weaknesses, usability issues, and areas for improvement.

• Apply consistent standards so that evaluations are objective, reproducible, and aligned with real-world product expectations.

• Incorporate feedback from senior reviewers and continuously refine evaluation approaches.

• Assess designs from the perspective of usability, accessibility, visual quality, interaction patterns, business objectives, and end-user needs.

3. Ideal Qualifications

• 5+ years of professional experience in product design, UI/UX, UX design, or design systems for real-world digital products.

• Experience working with leading digital-product or UX studios, product-led organizations, e-commerce platforms, marketplaces, or technology companies with sophisticated digital experiences.

• Relevant experience in one or more areas such as:

• Product / UI Designer

• UX Designer or UX Lead

• Design Systems Designer

• UX Writer / Content Designer

• Digital Product or Business Analyst

• Strong command of interaction design, visual design, responsive layouts, design systems, prototyping, usability principles, and end-to-end product flows.

• Hands-on proficiency with Figma and familiarity with production and engineering handoff processes.

• Ability to critically evaluate design decisions and articulate feedback at the level expected from a senior design or UX lead.

• Excellent written communication skills, with the ability to clearly explain why a design does or does not meet professional standards.

• Strong attention to detail and the ability to apply consistent evaluation criteria across different design solutions.

• Comfortable receiving feedback and having professional judgment reviewed and calibrated against other experts.

• Prior experience with AI training, AI evaluation, or human-data projects is a plus.

4. Application Process

• Submit your resume, portfolio, or relevant professional background.

• Qualified candidates may be asked to complete a brief design assessment or provide additional information about their experience.

• Selected professionals will receive further details about the project, evaluation process, and onboarding requirements.

5. Work Arrangement

• Fully remote engagement

• Flexible project-based schedule

• Work focused on digital product, UI/UX, and design evaluation

• Collaboration with an experienced research and review team

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

6. Contract and Payment Terms

• Engagement is structured as an independent contractor opportunity.

• Work can be completed remotely and generally on a flexible schedule.

• Projects may be extended, shortened, or concluded based on project requirements and performance.

• Work will not require access to confidential or proprietary information belonging to any current or former employer, client, or institution.

• Payments are made weekly through supported payment platforms based on services rendered.

• Candidates must meet all applicable eligibility requirements for the engagement.

Upload your resume once and Scout applies for you

Apply with Scout