Azure

Fireworks AI on Microsoft Foundry for Azure Inference

3 min read

Summary

Microsoft has launched a public preview of Fireworks AI on Microsoft Foundry, bringing high-throughput, low-latency open-model inference to Azure through a single managed endpoint. It matters because enterprises can now access models like DeepSeek V3.2, gpt-oss-120b, Kimi K2.5, and MiniMax M2.5 with Azure’s governance, serverless or provisioned deployment options, and bring-your-own-weights support—making it easier to move open-model AI from experimentation into production.

Need help with Azure?Talk to an Expert

Fireworks AI arrives on Microsoft Foundry

Introduction

Organizations adopting open models want more than raw performance—they need a practical way to run those models securely, govern them consistently, and move from testing to production without stitching together multiple tools. Microsoft’s new public preview of Fireworks AI on Microsoft Foundry is aimed at solving that problem by combining fast open-model inference with Azure’s enterprise management and governance capabilities.

What’s new

Microsoft Foundry now includes Fireworks AI as a public preview option for open model inference in Azure. The announcement positions Foundry as a centralized control plane for the full AI lifecycle, including model evaluation, deployment, customization, and operations.

Key updates include:

  • Public preview of Fireworks AI on Microsoft Foundry for high-throughput, low-latency open model inference
  • Access to supported open models through a single Azure endpoint in Foundry
  • Support for these models today:
    • DeepSeek V3.2
    • OpenAI gpt-oss-120b
    • Kimi K2.5
    • MiniMax M2.5
  • MiniMax M2.5 is newly added to Foundry with serverless support
  • Bring-your-own-weights (BYOW) support for quantized or fine-tuned models trained elsewhere
  • Deployment flexibility with:
    • Serverless, pay-per-token inference for rapid experimentation
    • Provisioned Throughput Units (PTUs) for predictable production performance

Microsoft also highlighted Fireworks AI’s large-scale inference capabilities, including internet-scale token processing and benchmark-leading throughput for open models.

Why this matters for IT and platform teams

For Azure administrators, AI platform teams, and enterprise architects, this reduces the operational complexity of supporting open models. Instead of building separate serving stacks or governance frameworks, teams can use Foundry as a single environment for model access, deployment, observability, and policy control.

This is especially relevant for organizations that want to:

  • Standardize on open models without vendor lock-in
  • Support custom fine-tuned models while keeping a consistent serving platform
  • Balance cost and performance across experimentation and production workloads
  • Apply enterprise governance and security controls to AI deployments in Azure

Admins and AI teams should:

  1. Review the Microsoft Foundry model catalog for Fireworks-hosted models.
  2. Evaluate whether serverless or PTU-based deployments best fit workload requirements.
  3. Test BYOW scenarios if your organization already has fine-tuned or quantized open models.
  4. Validate governance, observability, and operational requirements before production rollout.
  5. Track Microsoft’s additional guidance on model customization and lifecycle management in Foundry.

Fireworks AI on Microsoft Foundry gives Azure customers a stronger path to operationalizing open models at scale—without sacrificing performance, flexibility, or enterprise control.

Need help with Azure?

Our experts can help you implement and optimize your Microsoft solutions.

Talk to an Expert

Stay updated on Microsoft technologies

AzureMicrosoft FoundryFireworks AIopen modelsAI inference

Related Posts

Azure

Microsoft Foundry Adds Continuous Improvement for AI

Microsoft has introduced continuous improvement capabilities in Microsoft Foundry, enabling organizations to build, run, govern, and iteratively optimize AI agents using real-world traces, evaluations, and expert feedback. The update matters because it helps Azure customers improve agent quality, control cost and performance, and maintain governance as AI workloads scale.

Azure

Azure Ignite 2026: AI Infrastructure and Agent Updates

At Microsoft Ignite 2026, Microsoft announced major Azure updates focused on running AI and agents at scale with more control, better performance, and stronger governance. Highlights include Azure Cobalt 200 VMs, Azure Catalyst for agent-led modernization, HorizonDB for PostgreSQL workloads, Fabric apps, and the new Microsoft IQ context platform.

Azure

Azure Catalyst and AI Infrastructure Updates for 2026

Microsoft has announced Azure Catalyst, a new agent-led modernization solution designed to help organizations update applications, data, and infrastructure faster and at lower cost. The company also introduced new Azure AI infrastructure capabilities across AKS, agent security, context management, and hybrid deployment options, giving IT teams more flexibility to run AI workloads at scale.

Azure

Azure Cobalt 200 VMs Now Generally Available

Microsoft has announced the general availability of Azure Cobalt 200 VMs at Ignite 2026, bringing up to 50% better performance than Cobalt 100 for cloud-native, data-intensive, and agentic AI workloads. The new Arm-based VMs are available in 14 regions now, expanding to 23 by the end of 2026, with new VM families and Azure Boost support aimed at improving price-performance and efficiency.

Azure

Microsoft IQ Launches New Enterprise Context Platform

Microsoft has introduced Microsoft IQ, a new enterprise context management platform designed to help organizations bring their business knowledge, data, and processes into AI agents. The announcement matters for IT and development teams because it adds governed context, reusable business plugins, and broad integration across Microsoft Copilot, GitHub Copilot, Azure Foundry, and third-party AI tools.

Azure

Oracle AI Database@Azure Adds Agentic AI Tools

Microsoft and Oracle announced new integrations that bring agentic AI to enterprise workflows by combining Oracle business data with Microsoft Copilot, Work IQ, and Azure services. The update introduces Azure Workload Center for Oracle in limited preview, a new Oracle AI Database plug-in for Excel, and expanded developer tooling to build governed AI agents on trusted Oracle data.