Machine Learning System Software Architect
Baidu USAUpload your resume once and Scout applies for you
Apply with ScoutThis software architect will design system software and distributed training systems connecting Kunlun accelerators and servers. The role develops architecture and performance tools for Baidu’s AI SoC roadmap, working across software, hardware, and validation teams.
- Permanent
- On-site
- 5+ years
- Master's or PhD in Electrical or Computer Engineering
Skills and expertise
Key responsibilities
- Architect software systems for distributed AI training across Kunlun accelerators and servers.
- Develop system-level ML architectures and tools to evaluate performance, power, and cost.
- Work with software and SoC teams to optimize and implement the full hardware-software stack.
How this job compares
Compared with 410 open senior machine learning jobs on November 21, 2026.
- Pay
- This job does not publish its pay. The 143 open senior machine learning jobs that publish US pay start at $186K a year on average.
- Similar open jobs
- We Love AI Jobs lists 410 open senior machine learning jobs at 176 companies.
- Remote work
- This job is on site. 90 of the 410 senior machine learning jobs (22%) are remote.
- AI in this role
- High. AI is the core of the work: building, training or deploying AI systems. The role’s central responsibility is architecting machine-learning system software and distributed AI training infrastructure. It works with deep-learning frameworks and optimizes systems that support AI workloads.
Full description
Do you want to be part of the AI revolution? Do you want to think out of the box, thriving on challenges in AI industry and the desire to solve them? Do you want to work with a world-class team to explore the fast-growing AI hardware opportunities and impact on AI industry?
We’re looking forward to you joining us to collaborate, contribute, and revolutionize AI silicon and system.
Description
We are looking for a world-class Machine Learning System Software Architect to join our SoC team at Baidu’s Sunnyvale office. The successful candidate will be a motivated self-starter who will thrive in this highly technical environment. Your job responsibilities as a Machine Learning System Software Architect will help the team to architect and create high-performance machine learning system software and build the distributed AI training system by connecting thousands of Kunlun Accelerators and servers.
Create differentiated architectural innovations for Baidu’s Kunlun AI SoC roadmap. Architect, simulate, and design amazing machine learning solutions for our AI machine learning products.
Develop system-level ML architectures that push the boundaries of performance, power, and latency; and collaborate closely with many other teammates to ensure we design and optimize hardware and software for maximum performance.
Monitor industrial and academic trends in artificial intelligence and determine where they should intersect our roadmaps. Drive partnerships for access to the most advanced AI technologies
Evaluate the power, performance, and cost of prospective architecture and subsystems. Build scalable tools for modeling and performance evaluation.
Engage with system and application software engineers to ensure optimization of the entire hardware/software stack.
Work with SoC design, verification, and validation engineers to execute the architecture.
Qualifications
• Knowledge of Machine Learning market, technological and business trends, software ecosystem, and emerging applications.
• Proven track record of 5+ years architecting software solutions for Machine Learning, acceleration and optimization, especially in large distributed training system and HPC area.
• Experience with deep learning frameworks: TensorFlow/PyTorch/PaddlePaddle, etc.
• Strong track record of outreach to ML researchers and application developers.
• Experience with CPUs, GPUs, memory systems, and accelerators.
• Experience with performance simulation and modeling in C++
• MS or PhD in Electrical or Computer Engineering.
• Excellent communication skills in both English and Chinese.
Culture Fit:
• Mission alignment: If you want to be part of a team to accomplish this great mission, we will provide you the best possible platform to do that.
• Self-directed: We work best with people that are driven, motivated, and aspire to greatness.
• Hungry to learn: We are eager to see you learn new skills and grow.
• Team orientation: We work in small, fast-moving teams. We watch out for each other and go after big goals together as a team.
#LI-DNI
Upload your resume once and Scout applies for you
Apply with Scout