Principal Software Engineer, CoreAI

About this role

Set the roadmap and drive the execution of the training infrastructure built for AI workloads at a supercomputer scale. Design, develop and ship the backend services that power the AI workloads. Deliver deep insights that empower customers to troubleshoot and optimize their large-scale AI workloads Leverage production telemetry to influence next-generation infrastructure design, boosting efficiency, reliability, and performance Mentor and guide engineering teams, elevating technical excellence and championing a customer-focused approach to system design

Bachelor's Degree in Computer Science or related technical field and 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python or equivalent experience. These requirements include but are not limited to the following specialized security screenings: Excellent analytical and problem-solving skills, with the ability to extract customer pain points, synthesize ambiguous requirements, and design clear, scalable solutions. Expertise with distributed observability technologies (e.g., Prometheus, OpenTelemetry, Grafana) and 2+ years of experience designing or scaling telemetry pipelines for high-throughput production systems

Advanced, hands-on experience with production ML systems, large-scale training infrastructure, NCCL, CUDA libraries and tools. 6+ years of experience building or operating distributed systems, with a strong focus on reliability, scalability, and performance. Understanding of Docker, Kubernetes, scalable architectures, and automation for production systems

Passionate and self-motivated. Strong ability in self-learning, entering new domain, managing through uncertainty in an innovative team environment.

Apply for this role on Microsoft’s official careers site.