Back to jobs

Machine Learning Engineer, Core Evaluations

Cantina Labs
EuropeFull-time$200,000 – $220,000 / year

Upload your resume once and Scout applies for you

Apply with Scout
Share this job:LinkedInXSave image

This Machine Learning Engineer will create evaluation pipelines and dashboards for speech-generation and recognition models. As the founding evaluation team member, they will design metrics and user studies, train models for evaluation, and share findings with model, data, and product teams.

  • Permanent

Skills and expertise

Machine learning evaluationModel training and fine-tuningStatistical analysisUser study designASRTTSEvaluation pipelinesAutomated dashboards

Key responsibilities

  • Build evaluation pipelines and dashboards for models in development and production.
  • Design user studies and measurable metrics to assess model performance.
  • Use evaluation results to guide model, data, and product teams.

How this job compares

Compared with 329 open mid-level machine learning jobs on November 21, 2026.

Pay
This job pays $200K to $220K a year. The 119 open mid-level machine learning jobs that publish US pay start at $180K on average, so this job starts about 11% higher.
Similar open jobs
We Love AI Jobs lists 329 open mid-level machine learning jobs at 145 companies.
Remote work
This job is on site. 66 of the 329 mid-level machine learning jobs (20%) are remote.
AI in this role
High. AI is the core of the work: building, training or deploying AI systems. The core work is evaluating and training speech-generation and recognition models. The role develops model metrics, evaluation pipelines, and user studies on an ongoing basis.

Full description

About Cantina:

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.

If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!

About the Role:

We are seeking an experienced Machine Learning Engineer (MLE) to focus on audio model evaluation, specifically for speech generation and recognition models.

This role involves designing and developing comprehensive model evaluation pipelines for both development and production environments, as well as creating automated dashboards for reporting evaluation results.

As the founding member of our evaluation team, the ideal candidate is expected to leverage their experience to lead our evaluation efforts and play a key role in the future growth of the evaluation team.

What You’ll Do:

• Designing model evaluation pipelines for models in development and production

• Designing user studies for subjective model evaluations.

• Converting requirements into measurable metrics.

• Designing and developing automated evaluation dashboard to see model performances and compare results.

• Training new models to capture new and different evaluation metrics.

• Communicating with the model team to help design better models based on the evaluation results.

• Communicating with the data team to help decide the type of data necessary to improve model performance.

• Communication with the product-manager to make sure product requirements are correctly measured.

• Help grow the evaluation team as the founding member.

• Lead the evaluation team in the future.

What You’ll Bring:

• Strong experience and intuition for designing metrics that capture model performance.

• Strong experience with designing user studies on Mechanical Turk or similar platforms. .

• Strong experience with model training and fine-tuning for model evaluation.

• Strong statistical knowledge and experience to statistically compare evaluation results and take decisions.

• Very strong engineering and programming skills.

• Experience with training ASR, TTS models.

• Experience at ML teams working on large-scale machine learning problems. (>3B models with >1m hours of data)

Compensation:

The anticipated annual base salary range for this role is between $200,000-$220,000 (€170,000-€190,000). When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for U.S.-based roles:

• Competitive salary and generous company equity

• Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina

• 42 days of paid time off, including:

• 15 PTO days

• 10 sick days

• 15 company holidays

• 2 floating holidays

• Generous parental leave & fertility support

• 401(k) retirement savings plan

• Lifestyle spending account – $500/month to use however you’d like

• Complimentary lunch and snacks for in-office employees

• One Medical membership, and more!

Upload your resume once and Scout applies for you

Apply with Scout

Similar jobs