Back to jobs

Product Lead, Inference - USA

Inworld AI
Mountain View, California, USAFull-time$230,000 – $400,000 / year

Upload your resume once and Scout applies for you

Apply with Scout
Share this job:LinkedInXSave image

The Product Lead will own Inworld’s inference products, including model serving and routing for developers building real-time AI applications. The role sets product direction and performance targets while working hands-on with researchers and engineers to prototype, benchmark, and ship features.

  • Permanent
  • Hybrid
  • 6+ years
  • Bachelor’s Degree or higher in Computer Science, Engineering

Skills and expertise

LLM inferenceModel servingMulti-model routingAPIsLatency and reliability optimizationServing cost and unit economicsBenchmarkingServing data analysis

Key responsibilities

  • Set product strategy and prioritize capabilities for inference, first-party serving, and multi-model routing.
  • Define latency, reliability, and cost targets, and own results against them.
  • Prototype, benchmark, analyze serving data, and ship production features with engineering.

How this job compares

Compared with 31 open lead product jobs on November 22, 2026.

Pay
This job pays $230K to $400K a year. The 12 open lead product jobs that publish US pay start at $172K on average, so this job starts about 34% higher.
Similar open jobs
We Love AI Jobs lists 31 open lead product jobs at 25 companies.
Remote work
This job is hybrid. 8 of the 31 lead product jobs (26%) are remote.
AI in this role
High. AI is the core of the work: building, training or deploying AI systems. The role owns products for serving and routing LLMs, and works with researchers and engineers on AI capabilities. It also involves hands-on prototyping and benchmarking inference products.

Full description

About Inworld

Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.

Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production.

We’ve raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat. Inworld has also been recognized by CB Insights as one of the 100 most promising AI companies globally and named one of LinkedIn’s Top 10 Startups in the USA.

Your Impact

You will own Inworld’s inference products: the model serving and routing layer behind LLM for consumer apps at massive scale, where latency, reliability, and cost decide whether a product succeeds. This role is both strategic and hands on. You will set direction, make hard prioritization decisions, and personally ensure we ship products developers love and trust. You will collaborate with AI researchers and engineers to turn cutting-edge AI capabilities into reliable and scalable developer experiences. Your work will directly shape how the world serves and deploys real-time AI.

In this role, you will

• Drive product vision and strategy for Inworld’s inference products, including first-party model serving and multi-model routing, to enable the future of consumer scale AI applications

• Define the latency, reliability, and cost targets that matter for realtime workloads, and own the results against them

• Shape how inference is packaged and priced, grounded in a strong understanding of serving costs and unit economics

• Decide which models and serving capabilities to prioritize, and which workloads are best served on our own infrastructure versus routed to third-party providers

• Get hands on with code, both manually and with AI, to prototype, benchmark, analyze serving data, and ship production features and products in collaboration with engineering

• Work closely with C-level executives and industry leaders to align our product vision with business goals

• Synthesize partner and ecosystem feedback into clear product requirements and a prioritized roadmap, leading pre- and post-launch execution

You might be a good fit if you have

• BA/BS degree or higher in Computer Science, Engineering, or a similar technical field

• 6+ years of product management experience and an exceptional track record of building 0→1 developer products in high growth environments

• Experience owning an inference or ML serving product used by developers in production

• A working understanding of how LLM serving works and the tradeoffs between latency, throughput, quality, and cost

• Comfort owning outcomes rather than just roadmaps, with strong product judgment in ambiguous problem spaces

• Founder level mindset with the ability to spot gaps, propose solutions, and move work forward without waiting for direction

• Hands-on builder. You use AI coding tools to navigate the codebase, mock up features, run experiments, and pull your own data

• A passion for learning and staying up-to-date with the latest advancements in AI and its applications

In-office location: Mountain View, California, United States. Candidates must be based in the SF Bay Area or willing to relocate (you will be working on-site in our South Bay office a few days a week).

The US base salary range for this full-time position is $230,000 - $400,000 + bonus + equity + benefits.

Inworld Jobs Privacy

Upload your resume once and Scout applies for you

Apply with Scout

Similar jobs