Azure

Azure Storage 2026 for AI Training and Inference

3 min read

Summary

Microsoft’s Azure Storage 2026 roadmap centers on making storage a stronger backbone for AI at production scale, from training and tuning to always-on inference and agentic workloads. Key updates include massively scaled Blob accounts, expanded Azure Managed Lustre performance with up to 25 PiB namespaces and 512 GBps throughput, and tighter AI ecosystem integrations—important because they aim to reduce bottlenecks, simplify operations, and make high-performance AI and mission-critical enterprise workloads more cost-effective to run on Azure.

Need help with Azure?Talk to an Expert

Introduction: why this matters

AI is moving from occasional experimentation to always-on production—especially inference and autonomous “agentic” workloads that drive sustained, high-concurrency access patterns. Azure Storage’s 2026 roadmap focuses on enabling end-to-end AI data flows (training → tuning → inference), while also improving cost, operational simplicity, and performance for traditional mission-critical systems like SAP and ultra-low latency trading platforms.

What’s new (and what Microsoft is emphasizing)

1) Training at frontier scale: Blob and high-throughput data paths

  • Blob scaled accounts are highlighted as a way to scale across hundreds of scale units per region, targeting workloads with millions of objects (common in training/tuning datasets and checkpoint/model file management).
  • Microsoft notes that innovations used to support OpenAI-scale operations are becoming broadly available to enterprises.

2) Purpose-built storage for AI compute: Azure Managed Lustre (AMLFS)

  • Azure’s partnership with NVIDIA DGX on Azure pairs accelerated compute with Azure Managed Lustre for keeping GPU fleets fed.
  • AMLFS now includes preview support for 25 PiB namespaces and up to 512 GBps throughput, positioning it as a top-tier managed Lustre option for large research and industrial inference scenarios (e.g., automotive, robotics).

3) AI ecosystem integrations: faster paths from data to inference

  • Deeper integration is planned across AI frameworks including Microsoft Foundry, Ray/Anyscale, and LangChain.
  • Native Azure Blob integration within Foundry is positioned to help consolidate enterprise data into Foundry IQ for grounding knowledge, fine-tuning, and low-latency context serving—while keeping governance and security within the tenant.

4) Agentic scale cloud-native apps: block storage + Kubernetes orchestration

  • Microsoft calls out that agents can generate an order of magnitude more queries than human-driven apps, stressing storage/database layers.
  • Elastic SAN is described as a core building block for SaaS-style, multi-tenant architectures with managed block storage pools and guardrails.
  • Azure Container Storage (ACStor) directionally shifts toward the Kubernetes operator model and an intent to open source the code base, alongside CSI drivers, to simplify stateful app development on Kubernetes.

5) Mission-critical price/performance: SAP, ANF, Ultra Disk

  • For SAP HANA, Azure’s M-series updates target ~780k IOPS and 16 GB/s throughput for disk performance.
  • Azure NetApp Files (ANF) and Azure Premium Files continue as core shared storage options, with TCO improvements like ANF Flexible Service Level and Azure Files Provisioned v2.
  • Coming: Elastic ZRS service level in ANF for zone-redundant HA with synchronous replication across AZs.
  • Ultra Disk performance is emphasized (sub-500µs latency; up to 400K IOPS/10 GB/s, and up to 800K IOPS/14 GB/s with Ebsv6 VMs).

Impact on IT admins and platform teams

  • Expect more architectural focus on throughput, concurrency, and data locality for inference-heavy and agentic apps.
  • Kubernetes operators and potential open-source ACStor may change how teams standardize stateful workloads on AKS.
  • Storage selection becomes more workload-specific: Blob for datasets/context, Lustre for GPU pipelines, Elastic SAN/Ultra Disk for high-IOPS transactional demands, ANF for shared enterprise workloads.

Action items / next steps

  1. Map AI workloads by phase (training vs inference vs agentic) and align to storage types (Blob + AMLFS + block/shared).
  2. Review AMLFS preview limits (25 PiB/512 GBps) and validate GPU pipeline bottlenecks where Lustre can help.
  3. Evaluate Elastic SAN for multi-tenant SaaS or high-concurrency microservices needing pooled block storage.
  4. Plan for ANF Elastic ZRS if you need zone-redundant NFS with consistent performance for enterprise apps.
  5. For AKS teams, track ACStor operator + open-source updates to reduce bespoke stateful storage management.

Need help with Azure?

Our experts can help you implement and optimize your Microsoft solutions.

Talk to an Expert

Stay updated on Microsoft technologies

Azure StorageAzure Blob StorageAzure Managed LustreAKSElastic SAN

Related Posts

Azure

Microsoft Foundry Adds Continuous Improvement for AI

Microsoft has introduced continuous improvement capabilities in Microsoft Foundry, enabling organizations to build, run, govern, and iteratively optimize AI agents using real-world traces, evaluations, and expert feedback. The update matters because it helps Azure customers improve agent quality, control cost and performance, and maintain governance as AI workloads scale.

Azure

Azure Ignite 2026: AI Infrastructure and Agent Updates

At Microsoft Ignite 2026, Microsoft announced major Azure updates focused on running AI and agents at scale with more control, better performance, and stronger governance. Highlights include Azure Cobalt 200 VMs, Azure Catalyst for agent-led modernization, HorizonDB for PostgreSQL workloads, Fabric apps, and the new Microsoft IQ context platform.

Azure

Azure Catalyst and AI Infrastructure Updates for 2026

Microsoft has announced Azure Catalyst, a new agent-led modernization solution designed to help organizations update applications, data, and infrastructure faster and at lower cost. The company also introduced new Azure AI infrastructure capabilities across AKS, agent security, context management, and hybrid deployment options, giving IT teams more flexibility to run AI workloads at scale.

Azure

Azure Cobalt 200 VMs Now Generally Available

Microsoft has announced the general availability of Azure Cobalt 200 VMs at Ignite 2026, bringing up to 50% better performance than Cobalt 100 for cloud-native, data-intensive, and agentic AI workloads. The new Arm-based VMs are available in 14 regions now, expanding to 23 by the end of 2026, with new VM families and Azure Boost support aimed at improving price-performance and efficiency.

Azure

Microsoft IQ Launches New Enterprise Context Platform

Microsoft has introduced Microsoft IQ, a new enterprise context management platform designed to help organizations bring their business knowledge, data, and processes into AI agents. The announcement matters for IT and development teams because it adds governed context, reusable business plugins, and broad integration across Microsoft Copilot, GitHub Copilot, Azure Foundry, and third-party AI tools.

Azure

Oracle AI Database@Azure Adds Agentic AI Tools

Microsoft and Oracle announced new integrations that bring agentic AI to enterprise workflows by combining Oracle business data with Microsoft Copilot, Work IQ, and Azure services. The update introduces Azure Workload Center for Oracle in limited preview, a new Oracle AI Database plug-in for Excel, and expanded developer tooling to build governed AI agents on trusted Oracle data.