Speech-to-Speech English Voice AI Tester | $35/hr Remote

Speech-to-Speech English Voice AI Tester Work Snapshot

* Job Type: Contract

* Location: Remote

* Compensation: Up to $35 per hour

* Level: Middle to Senior Level

Roles & Responsibilities

* Interact with speech-based AI systems through short, natural voice conversations across real-world scenarios such as customer support, shopping, scheduling, and service inquiries

* Conduct conversational testing sessions lasting approximately 5 minutes while maintaining natural dialogue flow and realistic user behavior

* Evaluate AI model performance for conversational quality, accuracy, responsiveness, relevance, politeness, task completion, and naturalness

* Assess speech-based AI outputs for misunderstandings, incorrect assumptions, awkward phrasing, hallucinations, latency issues, and conversational breakdowns

* Compare and rate multiple conversational AI responses based on clarity, usability, reasoning quality, and contextual appropriateness

* Provide concise, high-quality written feedback documenting issues, edge cases, conversation failures, and successful interactions

* Follow structured evaluation rubrics and quality guidelines consistently across testing sessions

* Identify patterns in speech recognition failures, response inconsistencies, conversational flow issues, and task execution weaknesses

* Support AI model improvement through voice testing workflows, conversational evaluations, quality assurance reviews, and structured feedback documentation

* Collaborate asynchronously with AI training and evaluation teams to improve next-generation conversational and speech AI systems

Requirements

* Location: Must currently reside in the United States

* Fluent English proficiency with strong spoken, reading, and written communication skills

* Comfortable speaking naturally and clearly on microphone during short conversational sessions

* Strong writing skills with the ability to provide structured, specific, and actionable evaluation feedback

* Ability to assess conversational quality including clarity, relevance, tone, conversational flow, and task completion accuracy

* Detail-oriented with strong consistency in applying evaluation rubrics and following task instructions

* Reliable internet connection and access to a quiet environment suitable for voice-based testing sessions

* Comfortable interacting with conversational AI systems repeatedly across high-volume evaluation workflows

* Strong attention to conversational nuance, misunderstandings, awkward responses, and user experience quality

* Previous experience with QA testing, AI evaluation, conversational AI, customer support evaluation, annotation, or usability testing is preferred

* Familiarity with AI systems and tools such as ChatGPT, Gemini, voice assistants, or conversational AI platforms is a strong plus