Microsoft Defender Stops AI-Themed Phishing Attacks
Summary
Microsoft is warning that attackers are increasingly using trusted AI brands like ChatGPT, Copilot, Claude, and DeepSeek in phishing, malvertising, and malware campaigns. The company says Microsoft Defender can help security teams detect, correlate, and disrupt these multi-stage attacks across email, identities, endpoints, and SaaS apps.
Introduction
AI tools are now a common lure in phishing and malware campaigns, making social engineering attempts more believable for employees and consumers. Microsoft’s latest threat intelligence research shows why security teams need protection that spans email, identities, endpoints, and apps—not just isolated point detections.
What’s new
Microsoft detailed a rise in AI-themed attacks that impersonate well-known services including ChatGPT, Microsoft Copilot, Claude, and DeepSeek. These campaigns are not breaches of the AI platforms themselves; instead, attackers are exploiting user trust in those brands.
Examples highlighted by Microsoft include:
- A ChatGPT-themed phishing campaign that sent up to 100,000 emails in a single day to steal payment and credit card information.
- A Claude-themed adversary-in-the-middle (AiTM) campaign designed to capture credentials and access tokens.
- Malvertising for a fake AI Windows plugin that delivered the Vidar stealer.
- Fraudulent DeepSeek installers distributed through GitHub.
Microsoft also noted that these campaigns often use multi-stage redirect chains, disposable infrastructure, and tactics that move from email to identity compromise or endpoint infection.
How Microsoft Defender responds
Microsoft positioned Defender as a layered protection platform for these attacks:
- Anti-phishing policies help detect spoofing, impersonation, and suspicious sender behavior.
- Safe Links scans URLs during mail flow and at click time, helping block malicious redirects and delayed-activation links.
- Safe Attachments detonates files in a virtual environment before delivery.
- Post-delivery filtering can remove malicious content already delivered to mailboxes.
- Attack disruption correlates signals across email, identities, endpoints, and SaaS apps to automatically contain compromised assets.
According to Microsoft, Defender’s attack disruption capability now contains more than 81,000 compromised user accounts monthly and disrupts over 45,000 AiTM attacks each month.
Why this matters for IT admins
For administrators, the key takeaway is that AI-themed lures should be treated as part of the broader phishing and identity threat landscape. A single lure can start in email, lead to credential theft or malicious downloads, and quickly expand into business email compromise or lateral movement.
Next steps
IT and security teams should:
- Review anti-phishing, Safe Links, and Safe Attachments policies.
- Validate post-delivery remediation settings in Microsoft Defender.
- Monitor for lookalike AI-brand domains and unusual sign-in activity.
- Train users to verify AI-related update notices, plugins, and payment requests.
- Ensure analysts can investigate incidents across email, identity, and endpoint telemetry in one workflow.
As AI adoption grows, trusted AI brands will likely remain attractive bait for attackers. Organizations that connect prevention, detection, and response across the full attack chain will be better positioned to stop these campaigns early.
Need help with Security?
Our experts can help you implement and optimize your Microsoft solutions.
Talk to an ExpertStay updated on Microsoft technologies