Security

Microsoft Defender Stops AI-Themed Phishing Attacks

3 min read

Summary

Microsoft is warning that attackers are increasingly using trusted AI brands like ChatGPT, Copilot, Claude, and DeepSeek in phishing, malvertising, and malware campaigns. The company says Microsoft Defender can help security teams detect, correlate, and disrupt these multi-stage attacks across email, identities, endpoints, and SaaS apps.

Need help with Security?Talk to an Expert

Introduction

AI tools are now a common lure in phishing and malware campaigns, making social engineering attempts more believable for employees and consumers. Microsoft’s latest threat intelligence research shows why security teams need protection that spans email, identities, endpoints, and apps—not just isolated point detections.

What’s new

Microsoft detailed a rise in AI-themed attacks that impersonate well-known services including ChatGPT, Microsoft Copilot, Claude, and DeepSeek. These campaigns are not breaches of the AI platforms themselves; instead, attackers are exploiting user trust in those brands.

Examples highlighted by Microsoft include:

  • A ChatGPT-themed phishing campaign that sent up to 100,000 emails in a single day to steal payment and credit card information.
  • A Claude-themed adversary-in-the-middle (AiTM) campaign designed to capture credentials and access tokens.
  • Malvertising for a fake AI Windows plugin that delivered the Vidar stealer.
  • Fraudulent DeepSeek installers distributed through GitHub.

Microsoft also noted that these campaigns often use multi-stage redirect chains, disposable infrastructure, and tactics that move from email to identity compromise or endpoint infection.

How Microsoft Defender responds

Microsoft positioned Defender as a layered protection platform for these attacks:

  • Anti-phishing policies help detect spoofing, impersonation, and suspicious sender behavior.
  • Safe Links scans URLs during mail flow and at click time, helping block malicious redirects and delayed-activation links.
  • Safe Attachments detonates files in a virtual environment before delivery.
  • Post-delivery filtering can remove malicious content already delivered to mailboxes.
  • Attack disruption correlates signals across email, identities, endpoints, and SaaS apps to automatically contain compromised assets.

According to Microsoft, Defender’s attack disruption capability now contains more than 81,000 compromised user accounts monthly and disrupts over 45,000 AiTM attacks each month.

Why this matters for IT admins

For administrators, the key takeaway is that AI-themed lures should be treated as part of the broader phishing and identity threat landscape. A single lure can start in email, lead to credential theft or malicious downloads, and quickly expand into business email compromise or lateral movement.

Next steps

IT and security teams should:

  • Review anti-phishing, Safe Links, and Safe Attachments policies.
  • Validate post-delivery remediation settings in Microsoft Defender.
  • Monitor for lookalike AI-brand domains and unusual sign-in activity.
  • Train users to verify AI-related update notices, plugins, and payment requests.
  • Ensure analysts can investigate incidents across email, identity, and endpoint telemetry in one workflow.

As AI adoption grows, trusted AI brands will likely remain attractive bait for attackers. Organizations that connect prevention, detection, and response across the full attack chain will be better positioned to stop these campaigns early.

Need help with Security?

Our experts can help you implement and optimize your Microsoft solutions.

Talk to an Expert

Stay updated on Microsoft technologies

Microsoft DefenderphishingAI securitymalvertisingattack disruption

Related Posts

Security

Post-Quantum Authentication: Start PKI Testing Now

Microsoft is urging organizations to begin testing certificate ecosystems now for post-quantum authentication readiness. The company’s PQC TLS Pilot Program and Windows 11 support for ML-DSA certificates give PKI teams a controlled way to identify interoperability, performance, and operational issues before production adoption becomes necessary.

Security

Frontier AI Vulnerability Research: 3 Security Lessons

Microsoft Security’s FORGE Lab shared three operational lessons from using AI for vulnerability research at scale across Windows and open-source software. The findings show that the real challenge is no longer just discovering bugs with AI, but validating, deduplicating, and remediating them fast enough to turn research into shipped security fixes.

Security

AI Vulnerability Risks: Microsoft CISO Guidance

Microsoft says AI is dramatically increasing the volume and pace of vulnerability discovery, especially for on-premises software, forcing CISOs to rethink patching and resilience strategies. The company recommends faster patch prioritization, broader use of AI-assisted scanning, and stronger defense-in-depth with Microsoft Baseline Security Mode to reduce exposure.

Security

Microsoft Digital Defense Report 2026: Key Security Insights

Microsoft's 2026 Digital Defense Report highlights how AI and growing system interconnectedness are reshaping both cyberattacks and defense strategies. The report emphasizes that organizations must secure AI, identities, data, and cloud environments together while improving signal correlation across tools to detect modern threats faster.

Security

Government Cyber Risk in 2026: Microsoft’s 5 Priorities

Microsoft says government agencies were the most targeted sector in 2026, accounting for 27% of observed cyber threat activity. The company urges public-sector leaders to focus on five resilience priorities, including faster response, AI security, bidirectional information sharing, and planning for incidents that spread across suppliers and essential services.

Security

Microsoft Ignite 2026 Security Guide: Key Sessions

Microsoft has published its security guide for Microsoft Ignite 2026, highlighting AI-first security themes, a dedicated Security Pre-Day, and technical sessions focused on securing identities, data, devices, clouds, and AI agents. For IT and security teams, the event offers an early look at Microsoft’s roadmap and practical guidance for building an AI-ready security strategy.