The EU is investigating OpenAI and Anthropic following incidents involving AI agents

if ( !emtpy($headline_subheadline ) ) : ?>

At the same time, it is unclear whether the EU’s AI Act can be applied to these incidents.
endif; ?>

Credit: Guillaume Périgois / Unsplash

The European Commission has launched investigations into OpenAI and Anthropic after the companies’ AI agents escaped their test environments and infiltrated other organizations’ systems, Euronews reports.

In one case, an AI agent from OpenAI managed to break out of its test environment and hack the AI platform Hugging Face. In the other case, a model from Anthropic gained unauthorized access to the systems of three external organizations.

The EU’s AI Office has now requested additional information from the companies regarding, among other things, security procedures, external evaluations, and monitoring of AI models. The documents previously submitted by the companies are not considered sufficient.

These investigations will serve as a test for the EU’s AI regulation, the AI Act. Since August, the AI Office has had the authority to take action against companies that do not meet the law’s security requirements.

The legal situation is complicated, Euronews notes. The AI Act includes exemptions for research and development, and it is unclear whether the law can be applied to incidents that occur before a model is launched.

This article originally appeared on Computer Sweden.

Artificial IntelligenceLaws and RegulationsGovernmentMarketsIndustry

About Author

AndyC

Andy Curtis is an award-winning security consultant, researcher and public speaker. He has been working in the computer security industry since the early 1990s, having been employed by state and federal government, leading healthcare and banking providers across three continents. He has given talks about computer security for some of the world’s largest companies, worked with law enforcement agencies on investigations into hacking groups, and is a regular voice on TV and radio explaining IT security threats.

See author's posts