Back to jobs

Research Scientist / Engineer – Performance Optimization

Luma AI
Redwood City, CA (Hybrid)Full-time
AI tools:PyTorchTritonCUDANVIDIA Nsighttorch.compileTensorRTONNXXLA

Upload your resume once and Scout applies for you

Apply with Scout
Share this job:LinkedInXSave image

This role optimizes Luma’s multimodal models for training and deployment by improving GPU, CPU, and accelerator performance. The work spans custom kernels, transformer implementation, distributed deployment, and tooling to monitor performance gains.

  • Full-time
  • Hybrid
  • Expert-level

Skills and expertise

CUDATritonPyTorchGPU optimizationKernel developmentTransformer architecturesNVIDIA NsightDistributed deployment

Key responsibilities

  • Profile and optimize GPU, CPU, and accelerator code to improve utilization and reduce latency.
  • Develop high-performance PyTorch, Triton, and CUDA kernels, including fused kernels and custom operations.
  • Optimize transformer implementations for distributed production deployment and build performance monitoring tools.

How this job compares

Compared with 329 open mid-level machine learning jobs on November 21, 2026.

Pay
This job does not publish its pay. The 119 open mid-level machine learning jobs that publish US pay start at $180K a year on average.
Similar open jobs
We Love AI Jobs lists 329 open mid-level machine learning jobs at 145 companies.
Remote work
This job is hybrid. 66 of the 329 mid-level machine learning jobs (20%) are remote.
AI in this role
High. AI is the core of the work: building, training or deploying AI systems. The role directly optimizes the kernels, architectures, and deployment systems used to train and run multimodal models. Model performance work is the central responsibility.

Full description

You'll make Luma's multimodal models fast — profiling and optimizing GPU, CPU, and accelerator code so they train efficiently and deploy at scale without sacrificing quality. You'll write the kernels and operations that get the most out of the hardware.

This is deep performance work: fused kernels, tensor cores, Triton and CUDA, distributed multi-node deployment. It fits someone with expert GPU-optimization skills and a deep understanding of transformer internals. If you're not at home in CUDA, Triton, and profilers, this is the wrong depth.

What You'll Own

• Profile and optimize GPU/CPU/accelerator code for maximum utilization and minimal latency.

• Write high-performance PyTorch, Triton, and CUDA, dropping to custom operations when needed.

• Develop fused kernels and leverage tensor cores and modern hardware features across platforms.

• Optimize model architectures and implementations for distributed multi-node production deployment.

• Build performance monitoring and analysis tools and automation.

• Research and implement cutting-edge optimization techniques for transformer models.

First 90 Days

One way the first 90 could unfold.

• Days 1–30 — Immerse & Diagnose: Profile the current training and inference paths and find the biggest performance wins.

• Days 30–60 — Ship & Validate: Land a kernel or architecture optimization that measurably improves utilization or latency.

• Days 60–90 — Scale & Systemize: Build the monitoring and automation that keeps performance gains from regressing.

What You Bring

• Expert-level Triton/CUDA programming and GPU optimization.

• Strong PyTorch skills, including kernel development and custom operations.

• Proficiency with profiling tools (NVIDIA Nsight, torch profiler, custom tooling).

• Deep understanding of transformer architectures and attention mechanisms.

Nice to Have

• Experience with compilers and exporters (torch.compile, TensorRT, ONNX, XLA).

• Experience optimizing inference workloads for latency and throughput.

• Triton compiler and kernel fusion techniques.

• Knowledge of warp-level intrinsics and advanced CUDA optimization.

About Luma: Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer.

Upload your resume once and Scout applies for you

Apply with Scout

Similar jobs