Senior Applied AI Engineer

Senior Applied AI Engineer

Overview


Responsibilities

• Build agentic resolution capabilities for AFO
• Build and improve agentic patterns that raise autonomous resolution rate, accuracy, and customer satisfaction, contributing to the team's technical execution.
• Deliver engineering for Agentic AI solutions
• Deliver end-to-end features across autonomous AI systems, including orchestration, reasoning, retrieval, action execution, and human escalation workflows. Take capabilities from prototype through production across support surfaces while partnering effectively across dependent engineering teams.
• Contribute to technical direction and engineering standards
• Help shape the technical foundation for agent development by implementing architectures, design patterns, evaluation frameworks, and reusable platform capabilities.
• Apply and help improve standards for prompts, tool interfaces, testing, versioning, code quality, CI/CD, and safe deployment practices (shadow, canary, progressive rollout, automated rollback) so agent behavior remains reliable, observable, and scalable.
• Build evals that improve customer confidence that our agents are trustworthy in understanding customer sentiment and intent and in validating agentic actions.
• Contribute to production health and reliability
• Help run the service with a DevOps/SRE operating model. Support availability, latency, cost per resolution, SLOs and error budgets, regression detection, incident response, and the on-call rotation for a fleet of agents acting autonomously in the customer path. Build the observability needed to explain why an agent did what it did, and drive durable fixes rather than repeated mitigations.
• Build and maintain evaluation systems
• Contribute to the evaluation framework that determines whether agents are safe and effective in production. Build and maintain golden datasets, rubrics, judge agents, frozen anchors, and offline/online evaluation pipelines. Use evaluation signals to gate releases and continuously improve quality through production feedback loops.
• Contribute to measurable business impact
• Help move key business outcomes, including support demand reduction, autonomous resolution rate, resolution quality, time-to-resolution, engineer productivity, and customer satisfaction. Ensure the capabilities you build are measurable and directed toward the highest-impact opportunities.
• Turn Customer Signals into Engineering Insight
• Build mechanisms that convert unresolved cases, customer feedback, and dissatisfaction signals into actionable engineering insights. Help ensure recurring failure patterns improve future agent capabilities and route product fixes back to the appropriate engineering teams.
• Grow your craft and share learnings
• Deepen your agentic AI and DevOps craft, and extend the team's impact by sharing proven patterns, tools, and operational learnings with your peers.

 

Qualifications

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Experience Level

Senior Level