Back to jobs

Software Engineer, Product

Braintrust
San FranciscoFull-time
AI tools:GPT

Upload your resume once and Scout applies for you

Apply with Scout
Share this job:LinkedInXSave image

This product engineer will build user-facing features for Braintrust’s AI observability platform, working closely with users to shape the roadmap. Projects include a prompt playground, prompt management and comparisons, human review, and LLM output analysis.

  • Permanent
  • On-site

Skills and expertise

TypeScriptReactHTMLCSSSQLNext.jsPrompt managementLLM output analysis

Key responsibilities

  • Build user-facing features for prompt experimentation, management, review, and analysis.
  • Improve UI architecture, performance, and data loading patterns.
  • Work with users to shape the product roadmap and improve their observability workflows.

How this job compares

Compared with 1,047 open mid-level engineering jobs on November 21, 2026.

Pay
This job does not publish its pay. The 452 open mid-level engineering jobs that publish US pay start at $138K a year on average.
Similar open jobs
We Love AI Jobs lists 1,047 open mid-level engineering jobs at 274 companies.
Remote work
This job is on site. 104 of the 1,047 mid-level engineering jobs (10%) are remote.
AI in this role
High. AI is the core of the work: building, training or deploying AI systems. The role builds AI product features including a multi-model prompt playground and LLM output analysis. The posting also expects familiarity with prompts and GPT models.

Full description

About the company

Braintrust is the agent observability platform. By actively applying intelligence to agent traces and automatically surfacing the most critical patterns, Braintrust gives teams the visibility to understand how agents behave in production and the tools to improve them.

Teams at Notion, Stripe, Box, OpenAI, and Cloudflare use Braintrust to trace their agents, find the issues in their observability data, and run evals that tell them how to improve.

About the role

We're looking for a product engineer who is passionate about building tools that users love and use every day. You'll work on the core product, hang out with users (developers, product managers, and designers working in AI), and play a key role in shaping the roadmap.

Under the hood, Braintrust is a high performance, local-first, visualization-heavy UI built with modern Typescript and React. Our users work at some of the world's best technology companies and expect our product to be lightning fast, reliable, and intuitive.

What you'll do

Core responsibilities:

• Ensuring our customers always have a frictionless experience for enabling AI observability in their systems.

• Contribute to foundation UI architecture that focuses on performance and efficient data loading patterns.

Build the user-facing pieces of Braintrust, such as:

• A first-class prompt playground experience supporting multiple models across thousands of user inputs.

• A system for prompt management, configuration, and versioned comparisons.

• A fully multiplayer, scalable human review system.

• LLM output analysis and comparison across arbitrarily large datasets.

Ideal candidate credentials

• Expert-level understanding of Typescript, React, HTML, CSS, SQL, NextJS

• Previous experience founding or working at startups is a plus

• Has written prompts / tinkered with GPT models and apps

Benefits include

• Medical, dental, and vision insurance

• Daily lunch, snacks, and beverages

• Flexible time off

• Competitive salary and equity

• Wifi & cellphone stipend

Equal opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Upload your resume once and Scout applies for you

Apply with Scout

Similar jobs