Decoding the world of cybersecurity

Anthropic says new defences cut data extracted in AI model distillation attacks

Anthropic reports that its new anti-distillation methods reduced harvested model data by around 90–99% in early testing. The performance estimate is company-reported and subject to changing attacker behaviour.

Anthropic says new defences cut data extracted in AI model distillation attacks
Summary
  • Anthropic published updated anti-distillation research on 12 October.
  • The company estimates a 90–99% reduction in data harvested by attackers.
  • The claimed effect is early evidence, not an independently audited industry rate.

Anthropic says it has introduced new protections against attempts to extract Claude’s capabilities through unauthorised model distillation, reporting a substantial reduction in the data collected by such operations. In a research update published on 12 October, the company estimates that the new methods have cut data harvested by attackers by approximately 90% to 99% in its early evidence.

Model distillation involves using the responses or behaviour of one AI system to help train another. It can be an authorised technique in some research and development settings, but Anthropic’s concern is with unauthorised campaigns that make large volumes of queries through networks of accounts in order to copy useful capabilities without the original developer’s permission. Such activity can bypass the economic and technical cost of training a model from the beginning.

The company describes illicit distillation as an infrastructure-security problem because attackers can imitate legitimate API usage while aggregating outputs across many identities. Individual requests may look ordinary, making detection dependent on relationships between accounts, request patterns and the material being collected. The issue therefore extends beyond text generated by a model to authentication, abuse monitoring and the commercial access arrangements surrounding an AI service.

Anthropic’s reduction estimate is a result reported by the affected provider. It is not a measurement verified across competing AI platforms, nor does it establish that all distillation techniques have stopped working. The company says the evidence is early, and adversaries may adapt both their account practices and extraction methods. An effective intervention against one observed campaign may be less effective against a future variation.

Anthropic also raises governance questions about how downstream models are developed. Anthropic argues that a system trained by extracting another provider’s capabilities may be released without commensurate safety measures or testing. That is the company’s stated rationale, rather than proof that every model developed with unauthorised outputs will behave unsafely. Commercial competition, intellectual property and controls over dangerous capabilities are separate but connected issues.

European organisations increasingly use AI services through shared gateways, software development frameworks and application integrations. These systems may route requests through API keys and accounts whose normal business activity differs considerably by application. Distinguishing authorised enterprise usage from bulk extraction consequently demands accurate understanding of provider traffic and access permissions, especially where intermediaries obscure the original client.

Defence against illicit distillation is difficult because an AI service ordinarily exists to respond to user queries. Usage controls must decide when legitimate testing, education or business automation starts to resemble coordinated extraction without making the product unusable for ordinary customers. A malicious operator may spread requests across accounts or disguise repeated tasks among normal activity, so a narrow rate limit on one user identity may be insufficient. Providers can also identify correlations over time that would not be visible to an enterprise using the service through a third-party gateway.

Anthropic’s account says its methods have reduced harvesting in the campaigns it tracks, but it does not publish every detection feature in a way that independent testers could reproduce. That creates the familiar tension between transparency and the possibility of helping evasion. For customers, the distinction between a provider defending its own model and the customer protecting application credentials is important. A successful anti-distillation measure does not necessarily prevent a local gateway vulnerability or unauthorised retrieval of customer data. The two risk areas may involve overlapping APIs but different trust boundaries and incident consequences. The company presents its current result as progress under continuing adversarial pressure rather than a permanent end to extraction attacks.

The October report follows previous Anthropic disclosures about attempted industrial-scale capability extraction. It does not name a newly compromised European victim or confirm that model weights were stolen through a software breach. Its measurable claim concerns a reduction in the volume of model-derived information collected under the company’s monitoring, with the methodology and continued effectiveness subject to further scrutiny.

×