Azure

Microsoft Foundry Adds Continuous Improvement for AI

3 min read

Summary

Microsoft has introduced continuous improvement capabilities in Microsoft Foundry, enabling organizations to build, run, govern, and iteratively optimize AI agents using real-world traces, evaluations, and expert feedback. The update matters because it helps Azure customers improve agent quality, control cost and performance, and maintain governance as AI workloads scale.

Need help with Azure?Talk to an Expert

Microsoft Foundry gets continuous improvement for AI agents

Introduction

At Microsoft Ignite, Microsoft announced new continuous improvement capabilities for Microsoft Foundry. For Azure customers building AI agents, this is a notable step because it moves beyond one-time deployment and adds a structured way to improve agents over time using production data, user feedback, and governance controls.

This matters for IT leaders and platform teams that need AI systems to become more accurate, cost-efficient, and trustworthy as usage grows.

What’s new in Microsoft Foundry

Microsoft Foundry now supports an end-to-end improvement loop for AI agents:

  • Continuous learning from usage: Foundry can use agent traces and user input to help teams identify issues and improve agent behavior over time.
  • Evaluation-driven improvement: Organizations can define what “good” looks like with automated evaluations, rubric evaluators, and golden datasets.
  • Insights in GA: The Insights feature is now generally available to surface recurring problems, evidence, and likely root causes.
  • Agent optimizer enhancements: Foundry can recommend improvements to prompts, skills, and model selection, then test candidate changes before release.
  • New preview features: Microsoft highlighted annotations on traces, evaluation datasets, sending Insights issues to agent optimizer, skill optimization, and cost optimization.
  • Large model ecosystem: Foundry supports access to more than 11,000 models across Microsoft, OpenAI, Anthropic, Meta, Mistral, and open-source options.
  • Model router savings: Foundry’s model router can send simple requests to smaller models and complex requests to larger ones, with Microsoft claiming up to 65% cost savings versus always using frontier models.

Governance and runtime controls

Microsoft is also emphasizing governance as part of the platform:

  • Entra Agent ID gives agents an identity and supports least-privilege access.
  • Foundry guardrails and Foundry Safety help enforce runtime policies and keep sensitive actions under human oversight.
  • Teams remain in control because every proposed change is tested, reviewed, and explicitly approved before production deployment.

Impact on IT administrators and AI platform teams

For Azure administrators and AI operations teams, the update strengthens Foundry as a managed platform for enterprise agent lifecycle management. It combines development with GitHub, runtime operations on Azure, and governance through Entra and safety controls.

The practical benefit is clearer operational oversight: teams can monitor agent behavior, prioritize recurring issues, tune quality versus cost, and standardize how AI improvements are validated before rollout.

Next steps

If your organization is building or piloting AI agents on Azure, consider these actions:

  1. Review which Foundry features are GA versus preview before production use.
  2. Define evaluation criteria and golden datasets for your business use cases.
  3. Test model router and optimizer features to balance quality, latency, and cost.
  4. Validate governance settings with Entra Agent ID, guardrails, and human-in-the-loop controls.

Microsoft Foundry is positioning itself as more than an agent runtime. With continuous improvement, it becomes a platform for operating AI agents that can evolve safely and efficiently over time.

Need help with Azure?

Our experts can help you implement and optimize your Microsoft solutions.

Talk to an Expert

Stay updated on Microsoft technologies

Microsoft FoundryAzure AIAI agentsagent governancemodel optimization

Related Posts

Azure

Azure Ignite 2026: AI Infrastructure and Agent Updates

At Microsoft Ignite 2026, Microsoft announced major Azure updates focused on running AI and agents at scale with more control, better performance, and stronger governance. Highlights include Azure Cobalt 200 VMs, Azure Catalyst for agent-led modernization, HorizonDB for PostgreSQL workloads, Fabric apps, and the new Microsoft IQ context platform.

Azure

Azure Catalyst and AI Infrastructure Updates for 2026

Microsoft has announced Azure Catalyst, a new agent-led modernization solution designed to help organizations update applications, data, and infrastructure faster and at lower cost. The company also introduced new Azure AI infrastructure capabilities across AKS, agent security, context management, and hybrid deployment options, giving IT teams more flexibility to run AI workloads at scale.

Azure

Azure Cobalt 200 VMs Now Generally Available

Microsoft has announced the general availability of Azure Cobalt 200 VMs at Ignite 2026, bringing up to 50% better performance than Cobalt 100 for cloud-native, data-intensive, and agentic AI workloads. The new Arm-based VMs are available in 14 regions now, expanding to 23 by the end of 2026, with new VM families and Azure Boost support aimed at improving price-performance and efficiency.

Azure

Microsoft IQ Launches New Enterprise Context Platform

Microsoft has introduced Microsoft IQ, a new enterprise context management platform designed to help organizations bring their business knowledge, data, and processes into AI agents. The announcement matters for IT and development teams because it adds governed context, reusable business plugins, and broad integration across Microsoft Copilot, GitHub Copilot, Azure Foundry, and third-party AI tools.

Azure

Oracle AI Database@Azure Adds Agentic AI Tools

Microsoft and Oracle announced new integrations that bring agentic AI to enterprise workflows by combining Oracle business data with Microsoft Copilot, Work IQ, and Azure services. The update introduces Azure Workload Center for Oracle in limited preview, a new Oracle AI Database plug-in for Excel, and expanded developer tooling to build governed AI agents on trusted Oracle data.

Azure

Azure Cobalt 200 Boosts EDA Workload Performance

Microsoft shared early benchmark results showing Azure Cobalt 200 significantly improves electronic design automation (EDA) workloads used for silicon design and validation. In Microsoft’s internal testing, Cobalt 200 delivered 1.30x to 4.15x better performance than Cobalt 100 across simulation, verification, static timing, and physical signoff scenarios, highlighting its value for compute-intensive engineering workloads in Azure.