Azure

Microsoft Foundry Scales AT&T Telecom AI on Azure

3 min read

Summary

AT&T used Microsoft Foundry Managed Compute and AMD GPUs to build its OTel2.0 telecom AI models at trillion-token scale. The deployment highlights how Azure customers can combine open models, heterogeneous GPU infrastructure, and faster provisioning to reduce costs and accelerate production AI development.

Need help with Azure?Talk to an Expert

Microsoft Foundry scales AT&T telecom AI on Azure

Introduction

Microsoft is using AT&T’s OTel2.0 project to show what production-scale, domain-specific AI looks like on Azure. For IT leaders and platform teams, the announcement matters because it demonstrates how Microsoft Foundry Managed Compute can help organizations run very large AI workloads faster, with more model flexibility, and at lower cost.

What’s new

AT&T built the next generation of its telecom-focused AI models, OTel2.0, using Microsoft Foundry Managed Compute on Azure.

Key details from the deployment include:

  • Trillion-token scale: AT&T processed about 1 trillion tokens for OTel2.0 development.
  • Open-model strategy: The company used models from the Hugging Face ecosystem, including Phi-4, OSS-120B, and Gemma 4.
  • Heavy Phi-4 usage: Phi-4 alone processed more than 700 billion tokens per month for data preparation and synthetic data generation.
  • Large GPU footprint: AT&T used about 530 GPUs through Foundry Managed Compute, including 430 AMD Instinct MI300X GPUs.
  • Faster deployment: Foundry reportedly let teams deploy and scale in days instead of weeks.
  • Lower AI costs: Microsoft says AT&T saved tens of millions of dollars by using open-source models instead of frontier models for data generation.

Why it matters for Azure customers

This is more than a telecom success story. It shows how Azure is positioning Microsoft Foundry as a platform for organizations that need to build industry-specific AI systems without managing all the underlying infrastructure themselves.

For enterprise IT and AI platform teams, the main takeaways are:

  • Model choice matters: Teams can match different models to different tasks instead of forcing one model to do everything.
  • Infrastructure flexibility matters: Support for mixed GPU environments, including AMD and NVIDIA, can improve cost and performance planning.
  • Operational simplicity matters: Managed GPU access reduces provisioning delays and infrastructure overhead.
  • Cost optimization is becoming strategic: At large scale, open models may offer a more sustainable path for training, synthetic data generation, and experimentation.

Impact on administrators and technical decision-makers

Azure administrators, AI engineers, and infrastructure teams should view this as a reference architecture for production AI. If your organization is moving beyond pilots, Foundry Managed Compute may be relevant for workloads that require dedicated GPU capacity, governance, and faster scaling.

This is especially important for teams building AI in regulated or highly specialized industries where domain tuning, approved data use, and cost control are critical.

Next steps

  • Evaluate whether Microsoft Foundry Managed Compute fits your AI platform roadmap.
  • Review where open models could reduce inference or training costs.
  • Assess whether heterogeneous GPU strategies can improve flexibility in Azure.
  • Use this AT&T example as a benchmark for planning production-scale AI deployments.

Microsoft’s message is clear: Azure wants to be the platform where enterprises build their own specialized AI systems at scale.

Need help with Azure?

Our experts can help you implement and optimize your Microsoft solutions.

Talk to an Expert

Stay updated on Microsoft technologies

AzureMicrosoft FoundryAMD GPUsopen modelsAI infrastructure

Related Posts

Azure

Microsoft Foundry Adds Continuous Improvement for AI

Microsoft has introduced continuous improvement capabilities in Microsoft Foundry, enabling organizations to build, run, govern, and iteratively optimize AI agents using real-world traces, evaluations, and expert feedback. The update matters because it helps Azure customers improve agent quality, control cost and performance, and maintain governance as AI workloads scale.

Azure

Azure Ignite 2026: AI Infrastructure and Agent Updates

At Microsoft Ignite 2026, Microsoft announced major Azure updates focused on running AI and agents at scale with more control, better performance, and stronger governance. Highlights include Azure Cobalt 200 VMs, Azure Catalyst for agent-led modernization, HorizonDB for PostgreSQL workloads, Fabric apps, and the new Microsoft IQ context platform.

Azure

Azure Catalyst and AI Infrastructure Updates for 2026

Microsoft has announced Azure Catalyst, a new agent-led modernization solution designed to help organizations update applications, data, and infrastructure faster and at lower cost. The company also introduced new Azure AI infrastructure capabilities across AKS, agent security, context management, and hybrid deployment options, giving IT teams more flexibility to run AI workloads at scale.

Azure

Azure Cobalt 200 VMs Now Generally Available

Microsoft has announced the general availability of Azure Cobalt 200 VMs at Ignite 2026, bringing up to 50% better performance than Cobalt 100 for cloud-native, data-intensive, and agentic AI workloads. The new Arm-based VMs are available in 14 regions now, expanding to 23 by the end of 2026, with new VM families and Azure Boost support aimed at improving price-performance and efficiency.

Azure

Microsoft IQ Launches New Enterprise Context Platform

Microsoft has introduced Microsoft IQ, a new enterprise context management platform designed to help organizations bring their business knowledge, data, and processes into AI agents. The announcement matters for IT and development teams because it adds governed context, reusable business plugins, and broad integration across Microsoft Copilot, GitHub Copilot, Azure Foundry, and third-party AI tools.

Azure

Oracle AI Database@Azure Adds Agentic AI Tools

Microsoft and Oracle announced new integrations that bring agentic AI to enterprise workflows by combining Oracle business data with Microsoft Copilot, Work IQ, and Azure services. The update introduces Azure Workload Center for Oracle in limited preview, a new Oracle AI Database plug-in for Excel, and expanded developer tooling to build governed AI agents on trusted Oracle data.