Security

Microsoft Defender Stops AI-Themed Phishing Attacks

3 min read

Summary

Microsoft is warning that attackers are increasingly using trusted AI brands like ChatGPT, Copilot, Claude, and DeepSeek in phishing, malvertising, and malware campaigns. The company says Microsoft Defender can help security teams detect, correlate, and disrupt these multi-stage attacks across email, identities, endpoints, and SaaS apps.

Need help with Security?Talk to an Expert

Introduction

AI tools are now a common lure in phishing and malware campaigns, making social engineering attempts more believable for employees and consumers. Microsoft’s latest threat intelligence research shows why security teams need protection that spans email, identities, endpoints, and apps—not just isolated point detections.

What’s new

Microsoft detailed a rise in AI-themed attacks that impersonate well-known services including ChatGPT, Microsoft Copilot, Claude, and DeepSeek. These campaigns are not breaches of the AI platforms themselves; instead, attackers are exploiting user trust in those brands.

Examples highlighted by Microsoft include:

  • A ChatGPT-themed phishing campaign that sent up to 100,000 emails in a single day to steal payment and credit card information.
  • A Claude-themed adversary-in-the-middle (AiTM) campaign designed to capture credentials and access tokens.
  • Malvertising for a fake AI Windows plugin that delivered the Vidar stealer.
  • Fraudulent DeepSeek installers distributed through GitHub.

Microsoft also noted that these campaigns often use multi-stage redirect chains, disposable infrastructure, and tactics that move from email to identity compromise or endpoint infection.

How Microsoft Defender responds

Microsoft positioned Defender as a layered protection platform for these attacks:

  • Anti-phishing policies help detect spoofing, impersonation, and suspicious sender behavior.
  • Safe Links scans URLs during mail flow and at click time, helping block malicious redirects and delayed-activation links.
  • Safe Attachments detonates files in a virtual environment before delivery.
  • Post-delivery filtering can remove malicious content already delivered to mailboxes.
  • Attack disruption correlates signals across email, identities, endpoints, and SaaS apps to automatically contain compromised assets.

According to Microsoft, Defender’s attack disruption capability now contains more than 81,000 compromised user accounts monthly and disrupts over 45,000 AiTM attacks each month.

Why this matters for IT admins

For administrators, the key takeaway is that AI-themed lures should be treated as part of the broader phishing and identity threat landscape. A single lure can start in email, lead to credential theft or malicious downloads, and quickly expand into business email compromise or lateral movement.

Next steps

IT and security teams should:

  • Review anti-phishing, Safe Links, and Safe Attachments policies.
  • Validate post-delivery remediation settings in Microsoft Defender.
  • Monitor for lookalike AI-brand domains and unusual sign-in activity.
  • Train users to verify AI-related update notices, plugins, and payment requests.
  • Ensure analysts can investigate incidents across email, identity, and endpoint telemetry in one workflow.

As AI adoption grows, trusted AI brands will likely remain attractive bait for attackers. Organizations that connect prevention, detection, and response across the full attack chain will be better positioned to stop these campaigns early.

Need help with Security?

Our experts can help you implement and optimize your Microsoft solutions.

Talk to an Expert

Stay updated on Microsoft technologies

Microsoft DefenderphishingAI securitymalvertisingattack disruption

Related Posts

Security

Microsoft Sentinel Named a 2026 SIEM Leader

Microsoft has been named a Leader in the 2026 Gartner Magic Quadrant for SIEM, highlighting the continued momentum behind Microsoft Sentinel. The announcement also underscores Microsoft's push toward integrated, AI-powered security operations through deep Sentinel integration with the new Integrated Security Operations Center in Microsoft Defender.

Security

Microsoft Perception GA: Agentic Security at Ignite

Microsoft has made Microsoft Perception generally available, introducing an agentic security platform that coordinates red, blue, and green team agents through automated playbooks. Announced at Ignite 2026, the update also expands Defender and Sentinel capabilities to help security teams detect, investigate, and remediate AI-speed threats while keeping administrators in control.

Security

Device Code Phishing Risks for AI Coding Agents

Microsoft warns that device code phishing can be used against AI coding agents such as GitHub Copilot CLI, not just user mailboxes or cloud apps. In a controlled lab, a single approved device code sign-in could enable remote session steering, memory poisoning, synced session exposure, and private repository access depending on account permissions and enabled features.

Security

Microsoft 365 Outage Phishing Campaign Targets Users

Microsoft Threat Intelligence reported a high-volume phishing campaign that impersonates Microsoft 365 service-health notifications to trick users into clicking malicious links. The campaign matters because it uses outage-themed urgency and recipient-specific tracking to target multiple industries, increasing the risk of credential theft and follow-on account compromise.

Security

SCKit ScreenConnect Attack: MSPs Must Hunt Now

Microsoft Threat Intelligence confirmed a campaign abusing ConnectWise ScreenConnect to deploy unauthorized remote-access clients and the SCKit worm on MSP-managed endpoints. The activity can also target technician sessions, making this a high-priority incident for defenders because removing a rogue client alone does not eliminate persistence or invalidate exposed sessions.

Security

AI Agent Supply Chain Attacks Target Coding Tools

Microsoft Security researchers detailed two post-training supply chain attack paths that can backdoor coding and terminal agents: dataset poisoning and model poisoning. The findings matter because compromised agents can misuse tools, execute commands, and access sensitive environments even when prompts appear benign, reinforcing the need for stronger controls around training data, model provenance, and tool permissions.