Back to jobs

Member of Technical Staff – AI Inference platform, features

Lyceum
ZürichFull-time
AI tools:vLLMTGI

Upload your resume once and Scout applies for you

Apply with Scout
Share this job:LinkedInXSave image

You will build customer-facing capabilities for Lyceum’s AI inference platform, including model-serving options, APIs, and framework integrations. The role combines backend engineering with customer feedback and work to improve the deployment and debugging experience.

  • Full-time
  • On-site
  • 3+ years

Skills and expertise

GoPythonvLLMTGIREST APIsgRPCKubernetesModel deployment

Key responsibilities

  • Design and ship platform features, framework integrations, and support for new model architectures.
  • Work with customers and commercial teams to turn usage needs into technical designs.
  • Improve the experience of deploying, monitoring, and debugging inference workloads.

How this job compares

Compared with 1,047 open mid-level engineering jobs on November 22, 2026.

Similar open jobs
We Love AI Jobs lists 1,047 open mid-level engineering jobs at 274 companies.
Remote work
This job is on site. 104 of the 1,047 mid-level engineering jobs (10%) are remote.
AI in this role
High. AI is the core of the work: building, training or deploying AI systems. The role develops a platform for serving AI models and requires hands-on experience with inference frameworks. Supporting model deployment and serving is core to the work.

Full description

Your mission

You will expand the capabilities of Lyceum's AI inference platform, the first EU-sovereign inference cloud. You'll own the features that customers interact with directly: model serving configurations, API surface, framework integrations, and developer experience. This means understanding what customers need, building it fast, and making sure it works reliably at scale.

Your focus

• Feature development: Design and ship new platform capabilities - from supporting new model architectures and serving frameworks to building out API features that customers are asking for.

• Customer-facing engineering: Work closely with customers and the commercial team to understand real-world usage patterns, translate feature requests into technical designs, and iterate based on feedback.

• Developer experience: Improve the end-to-end experience of deploying and running inference on Lyceum, from initial setup through to monitoring and debugging in production.

Your KPIs

• Number of platform features shipped

• Time from customer request to feature availability

• Breadth of supported models, frameworks, and deployment configurations

Your profile

We consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected. You're someone who stays close to the rapidly evolving open-source AI ecosystem and gets energy from turning emerging tools into production-grade platform capabilities.

Requirements

• 3+ years of experience in software engineering, with a focus on backend or infrastructure systems

• Strong proficiency in Go and Python

• Hands-on experience with at least one ML inference serving framework (vLLM, TGI, etc)

• Solid understanding of how large language models and other AI models are deployed and served in production

• Experience working with REST/gRPC APIs and designing developer-facing interfaces

Nice to have

• Familiarity with GPU scheduling, batching strategies, or inference optimisation (quantisation, speculative decoding, etc.)

• Experience with Kubernetes and container orchestration in a production setting

• Knowledge of AI model formats and conversion pipelines (GGUF, SafeTensors, ONNX)

• Background in developer tools, platform engineering, or API design

Why us?

• Outstanding team: Work with some of the best engineers in the world, coming from hedge funds, big tech, AI startups and top universities

• Once in a lifetime opportunity: Early-stage company in the fastest-growing market in the world

• Ownership: Shape how European AI companies access GPU compute

• European mission: Build sovereign, GDPR-compliant AI infrastructure for the next generation of deep-tech

Upload your resume once and Scout applies for you

Apply with Scout

Similar jobs