Back to jobs

Senior Deep Learning Researcher, LLM Inference

NVIDIA
Israel, Tel AvivFull-time
AI tools:PyTorchvLLMTensorRT-LLM

Upload your resume once and Scout applies for you

Apply with Scout
Share this job:LinkedInXSave image

Research and implement algorithms that improve the latency and throughput of large language model inference. The role translates research into NVIDIA software, evaluates performance on NVIDIA hardware, and collaborates with research, engineering, and product teams.

  • Permanent
  • On-site
  • 5+ years
  • MSc or PhD

Skills and expertise

LLM inferenceDeep learning researchPythonPyTorchLLM architecturesInference optimizationHigh-performance computingGPU clusters

Key responsibilities

  • Research and implement algorithms for low-latency and high-throughput LLM inference.
  • Translate research advances into software improvements for NVIDIA products and customers.
  • Analyze algorithm performance on NVIDIA hardware and identify optimization opportunities.

How this job compares

Compared with 65 open senior research jobs on November 21, 2026.

Similar open jobs
We Love AI Jobs lists 65 open senior research jobs at 33 companies.
Remote work
This job is on site. 15 of the 65 senior research jobs (23%) are remote.
AI in this role
High. AI is the core of the work: building, training or deploying AI systems. Developing and optimizing LLM inference algorithms is the core of the role. The posting calls for hands-on deep learning research and implementation, including evaluation on GPUs.

Full description

We are seeking a highly motivated Senior Deep Learning Researcher to join our team! This is an outstanding opportunity to conduct impactful research and develop the next generation of large language model (LLM) inference algorithms. You will work on technologies that directly enhance NVIDIA's software, making the latest LLMs more efficient and accessible for users worldwide.

By joining us, you will be part of a strategic effort to establish NVIDIA as the definitive platform for high-performance LLM inference. You will engage with skilled problem-solvers at NVIDIA and top organizations, crafting AI technology advancements.

What you'll be doing:

• Research, invent, and implement groundbreaking algorithms for LLM inference to advance the state of the art in both low-latency and high-throughput scenarios.

• Translate research into practical software solutions that directly impact NVIDIA's products and customers.

• Collaborate with internal research, engineering, and product teams across the globe to drive the development of advanced inference technologies.

• Analyze the performance of new algorithms on NVIDIA’s latest hardware, identifying bottlenecks and opportunities for algorithmic optimizations.

• Partner with leading scientific organizations and industry pioneers to remain at the forefront of technological advancements and integrate the latest innovations into practical applications.

What we need to see:

• MSc/PhD in Computer Science, Electrical Engineering, or a closely related field.

• At least 5 years of relevant experience in deep learning research or applied research.

• Publications in a top-tier AI/ML conference (e.g., NeurIPS, ICLR, ICML).

• Deep understanding of LLM architectures coupled with hands-on experience in training large-scale models.

• Excellent programming skills, particularly in Python and deep learning frameworks like PyTorch, and experience with software engineering standards.

• A strong problem-solving mentality and a proactive attitude, driven by the ambition to deliver solutions with real-world impact.

Ways to stand out from the crowd:

• Hands-on research experience in LLM inference optimization algorithms such as speculative decoding or parallelization strategies.

• Proven experience with High-Performance Computing (HPC) environments, including training or running inference on large-scale GPU clusters (tens to hundreds of GPUs).

• Deep familiarity and experience with popular LLM inference systems (e.g., vLLM, TensorRT-LLM).

• Experience from a world-class industrial research group or a top-tier institution.

We are an equal-opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Upload your resume once and Scout applies for you

Apply with Scout

Similar jobs