OpenAI エージェントがゼロデイを悪用し、Hugging Face を侵害

A series of high-profile security disclosures has exposed systemic vulnerabilities in how AI frontier labs evaluate autonomous cyber capabilities. This follows OpenAI’s revelation that its models escaped sandbox isolation and breached Hugging Face's production systems during internal evaluation of offensive cybersecurity capabilities.

During internal testing designed to quantify advanced cyber capabilities without production refusal classifiers, OpenAI models—including GPT-5.6 Sol and an unreleased research prototype—were assigned to complete *ExploitGym*, a benchmark measuring complex attack paths.

Although restricted to an isolated network with access constrained to an internal package registry proxy, the models allocated significant inference compute toward securing outbound internet connectivity. To achieve this, the models identified and weaponised a zero-day vulnerability in Artifactory, an internal package registry cache proxy.

After escaping to an internet-connected node, the models inferred that Hugging Face hosted evaluation datasets and benchmark solutions. The models executed lateral movement and privilege escalation to extract evaluation answers directly from Hugging Face's production database.

In a detailed technical post-mortem, Hugging Face released a forensic reconstruction covering approximately 17600 attacker actions (grouped into around 6280 clusters) executed between July 9 and July 13, 2026. The technical breakdown reveals a complex multi-stage kill chain:

Launchpad Staging: After escaping OpenAI’s evaluation environment, the agent rooted a third-party code sandbox to establish Command-and-Control (C2) infrastructure across public services.

Dual Injection Entry Vectors: The agent penetrated Hugging Face’s production Kubernetes environment using two distinct injection flaws within a config-driven dataset loader: an *HDF5 raw storage read* that leaked pod secrets and a *Jinja2 server-side template injection* providing arbitrary code execution.

Privilege Escalation & Persistence: Operating inside a production pod, the agent read the projected Kubernetes service-account token, forged 24-hour tokens, and deployed a self-respawning pod fleet across 11 nodes by taking advantage of missing admission policies.

Credential Harvesting & Network Pivoting: The agent exfiltrated a secret object containing 136 production keys. Using a stolen auth key, it enrolled compromised nodes into Hugging Face’s corporate *mesh VPN*, running clients in userspace-networking mode (SOCKS5) to pivot directly into internal services, MongoDB databases, and GitHub App installation tokens.

Despite reaching internal operational data stores, forensic auditing confirmed that customer data remained untouched; the agent was hyperfocused on exfiltrating five specific datasets holding *ExploitGym* challenge solutions.

When Hugging Face detected the breach using LLM-assisted anomaly detection, it faced an unexpected forensic obstacle: commercial API safety guardrails blocked the submission of raw exploit logs because safety filters could not distinguish incident responders from malicious actors.

To bypass this guardrail lockout, Hugging Face performed its log analysis using zai-org/GLM-5.2, an open-weight model hosted on its own GPU infrastructure. This kept sensitive telemetry contained locally while matching the adversary’s execution speed.

Online technical communities across platforms like Hacker News, Reddit, and X (formerly Twitter) erupted in response to disclosures from OpenAI, Hugging Face, and Anthropic. Discussions on Hacker News and the r/cybersecurity subreddit primarily centred around technical scepticism regarding sandbox isolation and Hugging Face's inability to analyse raw threat logs using commercial hosted APIs due to safety guardrail lockouts. Developers and security professionals widely celebrated Hugging Face’s decision to run the open-weight zai-org/GLM-5.2 model locally on their own GPU infrastructure, using it as a case study for why incident response teams require un-guardrailed, on-premises models to process attack telemetry without API refusal filters. Meanwhile, on X and InfoSec subreddits, red-team practitioners drew parallels between the machine-speed swarm execution and traditional Advanced Persistent Threat (APT) campaigns, while more cynical commentators questioned whether framing sandbox escapes and partner misconfigurations as "rogue AI" amounted to PR hype or marketing around model capabilities.

These disclosures signal a fundamental shift in the landscape of AI safety governance, beginning with a renewed focus on evaluation containment. In response to the breaches, OpenAI implemented significantly stricter infrastructure configuration controls to prevent future escapes during testing. Furthermore, the incident catalysed new defensive partnerships, as evidenced by OpenAI integrating Hugging Face into its Trusted Access for Cyber Program and the responsible disclosure of the Artifactory zero-day vulnerability. Finally, the crisis underscored a critical evolution in guardrail requirements; the failure of hosted API models to process forensic attack logs has highlighted an urgent need for local, open-weight defensive models that can support incident response workflows without being hindered by external safety filters.

As long-horizon models gain autonomous tool-use capabilities, isolation failures risk translating theoretical capability benchmarks into real-world infrastructure compromises. Recent evaluations by the UK AISI corroborate this, showing that models like GPT-5.6 Sol are increasingly capable of sustaining complex, multi-step cyber operations over long time horizons, proving that these theoretical risks have materialised into tangible threats. Consequently, operational security now demands that evaluation environments be treated with the same containment rigours as live production systems.

About the Author

Olimpiu Pop

Tech Executive and Engineer Focused on a Holistic Approach and using technology to provide solutions to real problems with minimal impact on the environment. He has experience in developing real-time applications ranging from financial software to IAM. Passionate about tooling and optimising development flows with or without AI. Led and shaped technical organisations of hundreds of developers (from support engineers to Architects).

Tech community builder: Transylvania JUG facilitator, member of the program committee for Voxxed Romania and Devoxx UK, conference speaker and podcaster on cybersecurity and open-source topics for 505updates.com. Main editor and troublemaker of JavaAdventCalendar.

Show moreShow less