SOFTWARE ENGINEER II - Core AI
Microsoft · Shanghai, China · 11d ago
Do you want to help define how developers build and run the next generation of AI applications and agents? CoreAI is building the AI-first application stack at the center of Microsoft's AI platform strategy, bringing together models, agents, tools, data, evaluation, security, governance, and developer experiences.
Microsoft Foundry Service is a unified, production-ready platform that enables developers and enterprises to build, deploy, evaluate, publish, and operate AI applications and agents at scale. Foundry Agent Service provides managed runtimes for prompt agents and hosted agents, integrates models and reusable tools, and delivers enterprise capabilities such as Microsoft Entra identity, role-based access control, private networking, content safety, tracing, monitoring, evaluation, and lifecycle management. The platform supports both low-code and code-first development, allowing customers to use managed experiences or bring their own agent code and frameworks.
Making agent development simple creates challenging engineering opportunities across distributed systems, secure execution, session and state management, workload scheduling, scalability, reliability, observability, networking, identity, governance, and cost efficiency. Our services must provide a consistent developer experience while supporting diverse agent frameworks, tools, models, and compute environments for enterprise workloads.
The rapid evolution of generative AI and agentic applications is reshaping how software is built and operated. Come join CoreAI and help build Microsoft Foundry Service—the platform that enables every developer to create secure, reliable, and scalable AI applications and agents.
Responsibilities
We are looking for strong engineers who are passionate about building new AI platform capabilities while operating a globally distributed service. The ideal candidate can independently produce high-quality solutions and contribute to a collaborative and diverse team environment across organizations and geographies. You should be comfortable working in a fast-moving space, learning quickly, handling ambiguity, and changing direction as customer needs and AI technologies evolve.
In this role, you will design, build, and deliver services, features, and developer tools for Microsoft Foundry Service, with a focus on Foundry Agent Service and Hosted Agents. You may work on managed agent runtimes, secure and isolated execution, agent session lifecycle, workload scheduling and autoscaling, identity and networking integration, tools and model connectivity, observability, evaluation, publishing, and support for customer-managed compute such as Azure Kubernetes Service. You will work across open-source and Microsoft platform components written in multiple programming languages.
This is a unique opportunity to work on large-scale distributed AI systems and deliver foundational capabilities that are central to Microsoft's strategy for enterprise AI applications and agents.
Qualifications
Qualifications
5+ years of professional experience designing, developing, and shipping software using any of C#, C++, Java, Python, JavaScript/TypeScript, Rust, or Go.
Bachelor’s Degree in Computer Science or equivalent experience.
Preferred Qualifications:
Hands-on experience with distributed systems, cloud services, containers, orchestration platforms, or production AI infrastructure.
Proven ability to diagnose complex technical issues and improve the reliability, scalability, performance, security, and cost efficiency of online services.
Excellentwrittenand oral communication skills.
Experience in technical leadership in driving engineering roadmaps, leading v-teams, mentoring and helping others grow technically is a plus.
Experience building AI applications or agents using models, tools, retrieval, agent frameworks, evaluation, tracing, or observability is a plus.
Experience with Linux, Docker, Kubernetes, Azure Kubernetes Service, secure workload isolation, or cloud networking is a plus.
Experience using public cloud services, including Azure, AWS, or Google Cloud, and familiarity with identity, role-based access control, private networking, and operational monitoring.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.