Principal Software Engineer, ML Infrastructure

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Principal Software Engineer, ML Infrastructure in United States.

This role offers the opportunity to lead the design and development of high-performance, large-scale infrastructure that supports advanced machine learning and autonomous systems. You will set the technical vision for critical platforms that process massive datasets, orchestrate compute resources, and enable hundreds of engineers to build next-generation models. Working in a fast-paced, collaborative environment, you will influence architectural decisions, mentor peers, and contribute hands-on to complex, distributed systems. Your work will directly impact the reliability, scalability, and performance of mission-critical software, providing a foundation for cutting-edge AI applications. This position blends technical leadership with deep engineering expertise, allowing you to solve challenging problems at scale.

Accountabilities

* Architect, design, and lead the development of scalable, distributed ML infrastructure and services on Kubernetes

* Set the technical roadmap and make high-impact architectural decisions that accelerate AI and autonomous system development

* Mentor and guide engineers, fostering technical growth through design reviews, pair programming, and direct feedback

* Build and deploy complex infrastructure components, from high-throughput data processing pipelines to core compute orchestration

* Ensure reliability, scalability, and maintainability of ML platforms in production environments

* Collaborate with cross-functional teams to integrate infrastructure with ML workflows, enhancing overall system efficiency

Requirements

* 7+ years of professional software engineering experience

* BS, MS, or PhD in Computer Science or a related technical field

* Extensive hands-on experience with Kubernetes and designing/operating large-scale distributed systems

* Strong proficiency in Python, Go, or similar programming languages

* Experience with major cloud platforms (AWS, GCP, Azure) and deploying production-grade services

* Proven track record of leading complex, cross-functional projects from concept to production

* Excellent problem-solving, analytical, and communication skills for collaborative engineering environments

Benefits

* Competitive base salary range: $200,000 - $275,000 USD

* Potential for additional compensation such as bonuses or company equity

* Comprehensive health, dental, and vision coverage, including life and pet insurance

* 401(k) plan with company match and Health Savings Account (HSA) options

* Paid vacation, sick leave, and company holidays

* Professional development support including training and certifications

* Collaborative, inclusive, and mission-driven work environment

Why Apply Through Jobgether?

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.