Azure

Microsoft Foundry: Managing AI Models, Cost, Quality

3 min read

Summary

Microsoft Foundry is expanding its model ecosystem and operational tooling to help developers manage AI applications across selection, evaluation, optimization, and production operations. The update includes general availability of Fireworks AI on Microsoft Foundry, giving teams more model choice through a single Azure endpoint while improving cost control, governance, and lifecycle management.

Need help with Azure?Talk to an Expert

Introduction

Building an AI prototype is easier than ever, but running AI in production is a different challenge. Microsoft Foundry is positioning itself as a unified Azure platform for selecting, evaluating, optimizing, and operating AI models at scale—helping teams balance quality, latency, safety, and cost.

What’s new in Microsoft Foundry

The latest update focuses on model choice and operational discipline for production AI workloads.

  • Fireworks AI on Microsoft Foundry is now generally available
    • Developers can access production-grade open model inference through a single Azure endpoint.
    • The service includes enterprise SLAs and zero-setup onboarding.
  • Expanded model ecosystem
    • Foundry now supports a broader mix of Microsoft AI models, partner models, open-source models, custom models, and post-trained variants.
  • Model-agnostic operations
    • Teams can use one workflow for selection, evaluation, deployment, and monitoring instead of stitching together separate tools.
  • Model Router support
    • Foundry can automatically route requests to the most appropriate model based on workload type, cost targets, and latency requirements.

Why this matters for Azure teams

For IT and platform administrators supporting AI projects, the challenge is no longer just model access. The real issue is operating AI systems reliably in production.

Microsoft Foundry addresses common enterprise concerns:

  • Reducing vendor lock-in by supporting multiple model providers
  • Improving governance with repeatable evaluation and monitoring
  • Controlling costs through routing, batching, caching, and provisioned throughput
  • Supporting quality and safety validation using custom and built-in evaluators

This is especially relevant for RAG copilots, agentic workflows, and business process automation where performance, groundedness, and policy compliance matter as much as model capability.

Key operational takeaways

Organizations should treat model selection as an ongoing process, not a one-time decision.

  • Define success criteria before choosing a model
  • Test models with your own prompts, data, and expected outcomes
  • Evaluate for quality, safety, latency, throughput, and cost
  • Reassess continuously as new model versions and pricing options appear

Next steps

Azure teams evaluating Microsoft Foundry should:

  1. Review whether current AI workloads need multi-model routing
  2. Build custom evaluation datasets in CSV or JSONL
  3. Identify workloads that can benefit from cost optimization features like caching or batching
  4. Assess whether Fireworks AI on Foundry fits open-model production needs under Azure governance

For organizations scaling AI beyond pilot projects, Microsoft Foundry is becoming a key platform for operationalizing AI responsibly and efficiently on Azure.

Need help with Azure?

Our experts can help you implement and optimize your Microsoft solutions.

Talk to an Expert

Stay updated on Microsoft technologies

Microsoft FoundryAzure AIFireworks AIAI model managementmodel evaluation

Related Posts

Azure

Microsoft Foundry Adds Continuous Improvement for AI

Microsoft has introduced continuous improvement capabilities in Microsoft Foundry, enabling organizations to build, run, govern, and iteratively optimize AI agents using real-world traces, evaluations, and expert feedback. The update matters because it helps Azure customers improve agent quality, control cost and performance, and maintain governance as AI workloads scale.

Azure

Azure Ignite 2026: AI Infrastructure and Agent Updates

At Microsoft Ignite 2026, Microsoft announced major Azure updates focused on running AI and agents at scale with more control, better performance, and stronger governance. Highlights include Azure Cobalt 200 VMs, Azure Catalyst for agent-led modernization, HorizonDB for PostgreSQL workloads, Fabric apps, and the new Microsoft IQ context platform.

Azure

Azure Catalyst and AI Infrastructure Updates for 2026

Microsoft has announced Azure Catalyst, a new agent-led modernization solution designed to help organizations update applications, data, and infrastructure faster and at lower cost. The company also introduced new Azure AI infrastructure capabilities across AKS, agent security, context management, and hybrid deployment options, giving IT teams more flexibility to run AI workloads at scale.

Azure

Azure Cobalt 200 VMs Now Generally Available

Microsoft has announced the general availability of Azure Cobalt 200 VMs at Ignite 2026, bringing up to 50% better performance than Cobalt 100 for cloud-native, data-intensive, and agentic AI workloads. The new Arm-based VMs are available in 14 regions now, expanding to 23 by the end of 2026, with new VM families and Azure Boost support aimed at improving price-performance and efficiency.

Azure

Microsoft IQ Launches New Enterprise Context Platform

Microsoft has introduced Microsoft IQ, a new enterprise context management platform designed to help organizations bring their business knowledge, data, and processes into AI agents. The announcement matters for IT and development teams because it adds governed context, reusable business plugins, and broad integration across Microsoft Copilot, GitHub Copilot, Azure Foundry, and third-party AI tools.

Azure

Oracle AI Database@Azure Adds Agentic AI Tools

Microsoft and Oracle announced new integrations that bring agentic AI to enterprise workflows by combining Oracle business data with Microsoft Copilot, Work IQ, and Azure services. The update introduces Azure Workload Center for Oracle in limited preview, a new Oracle AI Database plug-in for Excel, and expanded developer tooling to build governed AI agents on trusted Oracle data.