Azure

Azure AI Infrastructure Expands With NVIDIA at GTC

3 min read

Summary

Microsoft announced major Azure AI updates at NVIDIA GTC, including expanded Microsoft Foundry capabilities, new Azure infrastructure for inference-heavy AI workloads, and deeper support for Physical AI. The changes matter because they help organizations build and run production-grade AI agents, prepare for next-generation NVIDIA systems, and extend AI into regulated and real-world operational environments.

Need help with Azure?Talk to an Expert

Introduction

Microsoft used NVIDIA GTC to outline a broader Azure AI strategy focused on production-ready agents, inference-optimized infrastructure, and Physical AI. For IT leaders and platform teams, the announcement signals faster paths from AI experimentation to governed enterprise deployment.

What’s new in Microsoft Foundry

Microsoft expanded Microsoft Foundry as its enterprise AI platform for building, deploying, and operating agents at scale.

Key updates include:

  • Foundry Agent Service is now generally available for building AI agents that can reason, plan, and act across tools, data, and workflows.
  • Observability in the Foundry Control Plane is also generally available, giving teams better visibility into agent behavior and operations.
  • Voice Live API integration for Foundry Agent Service is now in public preview, enabling voice-first and multimodal real-time agent experiences.
  • A refreshed Microsoft Foundry portal is now generally available.
  • NVIDIA Nemotron models are now available in Microsoft Foundry, expanding the model catalog for enterprise AI workloads.

Microsoft also highlighted additional integrations with security and governance partners such as Palo Alto Networks Prisma AIRS and Zenity.

Azure AI infrastructure gets a major boost

Microsoft is also expanding Azure infrastructure to support inference-heavy, reasoning-based AI workloads.

Highlights include:

  • Azure is the first hyperscale cloud to power on NVIDIA Vera Rubin NVL72 systems in Microsoft labs.
  • Vera Rubin NVL72 is expected to roll out to Azure datacenters over the coming months.
  • Microsoft says it has already deployed hundreds of thousands of liquid-cooled Grace Blackwell GPUs globally in under a year.
  • Azure Local now has initial support for the NVIDIA Vera Rubin platform, helping customers in sovereign and regulated environments run advanced AI closer to where data resides.

Physical AI and digital twins on Azure

Microsoft and NVIDIA are also deepening work around Physical AI.

New capabilities include:

  • A public Azure Physical AI Toolchain GitHub repository integrated with NVIDIA Physical AI Data Factory and core Azure services.
  • Deeper integration between Microsoft Fabric and NVIDIA Omniverse libraries.
  • Support for workflows that connect live operational data, digital twins, simulation, and AI-driven actions.

This is especially relevant for manufacturing, energy, and industrial operations where organizations want AI to move beyond dashboards into real-time decision support and automation.

Why this matters for IT admins

For Azure administrators and enterprise architects, these announcements point to three priorities:

  • Better tooling for moving AI agents from pilot to production
  • More infrastructure options for high-performance inference and reasoning workloads
  • Stronger support for regulated, sovereign, and edge scenarios with Azure-consistent governance

Next steps

Organizations evaluating Azure AI should review Microsoft Foundry GA features, assess Nemotron model support, and watch for Azure availability of Vera Rubin NVL72. Teams in industrial sectors should also explore the new Physical AI Toolchain and Fabric-Omniverse integration for digital twin and simulation use cases.

Need help with Azure?

Our experts can help you implement and optimize your Microsoft solutions.

Talk to an Expert

Stay updated on Microsoft technologies

Azure AIMicrosoft FoundryNVIDIAPhysical AIAzure infrastructure

Related Posts

Azure

Microsoft Foundry Adds Continuous Improvement for AI

Microsoft has introduced continuous improvement capabilities in Microsoft Foundry, enabling organizations to build, run, govern, and iteratively optimize AI agents using real-world traces, evaluations, and expert feedback. The update matters because it helps Azure customers improve agent quality, control cost and performance, and maintain governance as AI workloads scale.

Azure

Azure Ignite 2026: AI Infrastructure and Agent Updates

At Microsoft Ignite 2026, Microsoft announced major Azure updates focused on running AI and agents at scale with more control, better performance, and stronger governance. Highlights include Azure Cobalt 200 VMs, Azure Catalyst for agent-led modernization, HorizonDB for PostgreSQL workloads, Fabric apps, and the new Microsoft IQ context platform.

Azure

Azure Catalyst and AI Infrastructure Updates for 2026

Microsoft has announced Azure Catalyst, a new agent-led modernization solution designed to help organizations update applications, data, and infrastructure faster and at lower cost. The company also introduced new Azure AI infrastructure capabilities across AKS, agent security, context management, and hybrid deployment options, giving IT teams more flexibility to run AI workloads at scale.

Azure

Azure Cobalt 200 VMs Now Generally Available

Microsoft has announced the general availability of Azure Cobalt 200 VMs at Ignite 2026, bringing up to 50% better performance than Cobalt 100 for cloud-native, data-intensive, and agentic AI workloads. The new Arm-based VMs are available in 14 regions now, expanding to 23 by the end of 2026, with new VM families and Azure Boost support aimed at improving price-performance and efficiency.

Azure

Microsoft IQ Launches New Enterprise Context Platform

Microsoft has introduced Microsoft IQ, a new enterprise context management platform designed to help organizations bring their business knowledge, data, and processes into AI agents. The announcement matters for IT and development teams because it adds governed context, reusable business plugins, and broad integration across Microsoft Copilot, GitHub Copilot, Azure Foundry, and third-party AI tools.

Azure

Oracle AI Database@Azure Adds Agentic AI Tools

Microsoft and Oracle announced new integrations that bring agentic AI to enterprise workflows by combining Oracle business data with Microsoft Copilot, Work IQ, and Azure services. The update introduces Azure Workload Center for Oracle in limited preview, a new Oracle AI Database plug-in for Excel, and expanded developer tooling to build governed AI agents on trusted Oracle data.