Principal Software Engineer - CoreAI
 Microsoft | |
 United States, Washington, Redmond | |
 Sep 21, 2025 | |
|
OverviewJoin our team withinCoreAI, where we are building theAI data-planethat powers all LLM inferencing workloads across Microsoft and Azure customers-from cutting-edge startups to Fortune 500 enterprises. Ourconverged AI fabricdelivers inference capabilities for all LLMs in Microsoft catalog, including OpenAI, Mistral, Cohere, Llama, and more. As aPrincipal Software Engineer - CoreAI, you will shape the future of one of thelargest and fastest-growing services in Azure, foundational to Microsoft's AI strategy. Our mission is to serve models at scale-reliably, efficiently, and with ultra-low latency-enabling a rich set of AI-powered product experiences. This is a rapidly evolving space with immense opportunities to learn, innovate, and drive industry-wide impact. In this role, you will:Drive innovation and deliver impact on acritical Azure servicethat underpins Microsoft's AI vision. Collaborate with aworld-class teamof engineers, architects, and leaders committed to technical excellence and career growth. Innovate on product shape and offers to define how developers leverage cutting edge AI technologies and build world class applications. Ship new product features and improvements at a high velocity where ideas to production is a matter of week(s) At Microsoft, our mission is toempower every person and every organization on the planet to achieve more. We embrace a growth mindset, foster innovation, and work together to realize our shared goals. Every day, we build on our values ofrespect, integrity, and accountabilityto create a culture where everyone can thrive.
ResponsibilitiesDesign, implement and deliver AI services to support product offerings for large-scale LLM serving. Collaborate closely with product management and partner teams to align technical direction with business goals. Coach and grow team members with design, code reviews, and mentorship serving as a role model leading product quality and velocity. Engage with customers to gather feedback and resolve complex issues. Innovate on technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products. Embody ourcultureandvalues | |