Research Scientist / Engineer – Training Infrastructure
Luma AIUpload your resume once and Scout applies for you
Apply with ScoutYou will build and optimize distributed training infrastructure for Luma’s multimodal foundation models across large GPU clusters. The work focuses on parallelism, training reliability, monitoring, and efficient use of compute so researchers can train models at scale.
- Permanent
- Hybrid
Skills and expertise
Key responsibilities
- Design and optimize distributed training systems for models running across thousands of GPUs.
- Implement advanced parallelization strategies, including FSDP and tensor, pipeline, and expert parallelism.
- Build monitoring and debugging tools while improving training stability and cluster utilization.
How this job compares
Compared with 522 open senior infrastructure jobs on November 22, 2026.
- Pay
- This job does not publish its pay. The 183 open senior infrastructure jobs that publish US pay start at $170K a year on average.
- Similar open jobs
- We Love AI Jobs lists 522 open senior infrastructure jobs at 190 companies.
- Remote work
- This job is hybrid. 111 of the 522 senior infrastructure jobs (21%) are remote.
- AI in this role
- High. AI is the core of the work: building, training or deploying AI systems. The role directly supports training large-scale multimodal models and requires hands-on distributed PyTorch training and optimization.
Full description
You'll build the distributed systems that train Luma's large-scale multimodal models across thousands of GPUs, so researchers can focus on innovation on top of reliable, efficient, scalable infrastructure.
This is hard PyTorch, CUDA, and distributed-systems work — advanced parallelism, training stability, and utilization across massive clusters. It fits an engineer who's solved real problems training foundation models at scale. If you haven't worked at the level of FSDP and multi-node training, this is the wrong depth.
What You'll Own
• Design, implement, and optimize efficient distributed training systems for models across thousands of GPUs.
• Research and implement advanced parallelization (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel).
• Build monitoring, visualization, and debugging tools for large-scale training runs.
• Optimize training stability, convergence, and resource utilization across massive clusters.
First 90 Days
One way the first 90 could unfold.
• Days 1–30 — Immerse & Diagnose: Learn the current training stack and where stability and utilization hurt at scale.
• Days 30–60 — Ship & Validate: Land a parallelization or stability improvement that measurably helps a real training run.
• Days 60–90 — Scale & Systemize: Build the monitoring and tooling that keeps large runs reliable and efficient.
What You Bring
• Extensive distributed PyTorch training and parallelisms in foundation-model training.
• Deep understanding of GPU clusters, networking, and storage systems.
• Familiarity with communication libraries (NCCL, MPI) and distributed-system optimization.
Nice to Have
• Strong Linux systems administration and scripting.
• Experience managing training runs across 100+ GPUs.
• Experience with containerization, orchestration, and cloud infrastructure.
About Luma: Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer.
Upload your resume once and Scout applies for you
Apply with Scout