news.mlab.sh
Back to the feed
threat-intel

World's Largest AI Model Repository Hugging Face Breached by Autonomous AI Agent

High
Summary

Hugging Face, a leading AI model repository, was hacked by an autonomous AI agent system. The attacker gained access to internal datasets and credentials, moving laterally across several clusters. While public-facing models and data remained untouched, the incident highlighted a critical vulnerability related to AI agent security and the need for robust defenses against similar attacks.

Hugging Face, a prominent open-source AI platform, has been targeted by a sophisticated attack orchestrated by an autonomous AI agent system. The company detected and responded to the intrusion targeting its production infrastructure earlier last week. "We identified unauthorized access to a limited set of internal datasets and to several credentials used by our services," the company stated in a statement. The attack originated within the data processing pipeline, exploiting two code execution paths – a remote code dataset loader and a template injection in a dataset configuration – to execute code on processing workers. This access allowed the threat actor to escalate to node-level access, collect cloud and cluster credentials, and move laterally into several internal clusters over a weekend. The exact large language model (LLM) used to pull off the attack remains unclear, but the campaign involved an autonomous agent framework performing "many thousands of individual actions across a swarm of short-lived sandboxes, with self-migrating command-and-control staged on public services." Hugging Face has since addressed the root cause by removing the attacker's foothold and rebuilding compromised nodes. They also revoked and rotated affected credentials, implemented stricter admission controls, and improved detection and alerting. Notably, the company turned to Z.ai's GLM 5.2, a Chinese open-weight model, to conduct forensic analysis, as Western hosted models refused to analyze attack commands due to their safety guardrails. Hugging Face is urging customers to rotate access tokens and review recent account activity. The incident underscores a significant gap in AI defense, particularly regarding the potential for autonomous agents to bypass traditional security measures.

Read the full article at The Hacker News