GPU Performance Engineer
GenmoUpload your resume once and Scout applies for you
Apply with ScoutYou’ll optimize Genmo’s GPU workloads and model-serving stack, profiling bottlenecks and improving performance on H100 infrastructure. The role involves kernel development, latency reduction, and close collaboration with ML engineers to improve model execution.
- Permanent
- On-site
- 5+ years
- Bachelor's or Master's Degree
Skills and expertise
Key responsibilities
- Profile GPU workloads and identify performance bottlenecks using profiling tools.
- Develop CUDA and Triton kernels and optimize memory access and GPU utilization.
- Reduce serving latency and troubleshoot performance issues across the stack.
How this job compares
Compared with 522 open senior infrastructure jobs on November 21, 2026.
- Pay
- This job does not publish its pay. The 183 open senior infrastructure jobs that publish US pay start at $170K a year on average.
- Similar open jobs
- We Love AI Jobs lists 522 open senior infrastructure jobs at 190 companies.
- Remote work
- This job is on site. 111 of the 522 senior infrastructure jobs (21%) are remote.
- AI in this role
- Medium. The role uses AI tools and works with AI systems as a regular part of the job. The role optimizes GPU workloads and the serving stack used for model operations, and works directly with ML engineers. Its focus is infrastructure performance rather than developing AI models.
Full description
We are Genmo, a research lab developing the world’s most sophisticated video world models to understand, simulate, and interact with the physical world. Our mission is to unlock the right brain of AGI. Join us in advancing physical intelligence and enabling robots to learn and act in a changing world.
We're seeking a GPU Performance Engineer to squeeze every last FLOP from our H100 infrastructure and optimize our model serving stack to its absolute limits.
The Role
You'll be our performance optimization expert, using advanced profiling tools to identify bottlenecks and implementing solutions that achieve 5-10x speedups. From writing custom CUDA kernels to eliminating cold start latency, you'll ensure our infrastructure delivers world-class performance. This role is perfect for someone who gets excited about microsecond optimizations and pushing hardware to its theoretical limits.
Key Responsibilities
• Profile and optimize GPU workloads using Nsight Systems, nvprof, and custom instrumentation
• Write high-performance CUDA and Triton kernels for critical model operations
• Optimize cold start latency from seconds to milliseconds for our serving infrastructure
• Tune memory access patterns, kernel fusion, and GPU utilization
• Collaborate with ML engineers to optimize model implementations
• Debug performance issues across the full stack from application to hardware
• Implement custom memory pooling and allocation strategies
• Share optimization techniques and build performance culture across teams
Qualifications
• Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field
• 5+ years systems programming experience with 3+ years focused on GPU optimization
• Expert proficiency with GPU profiling tools (Nsight Systems, nvprof)
• Strong CUDA programming skills with production kernel development
• Deep understanding of GPU architecture (memory hierarchy, SMs, warps)
• Track record of achieving significant performance improvements (5-10x)
• Experience with Python and C++ in production environments
We Value
• Experience with Triton kernel development
• Knowledge of CUTLASS or similar high-performance libraries
• Background in ML-specific optimizations (attention, transformers)
• RDMA/InfiniBand optimization experience
• Contributions to GPU libraries or frameworks
• Low-level debugging skills (PTX/SASS reading)
Genmo is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Genmo, Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.
Upload your resume once and Scout applies for you
Apply with Scout