Anthropic’s Opus 5 Is Better at Resisting Prompt Injection
Anthropic’s Opus 5 Is Better at Resisting Prompt Injection The chart is interesting. On the IPI benchmark, Opus 5 improved...
benchmark
Measuring LLMs’ Ability to Perform Cryptanalysis
Measuring LLMs’ Ability to Perform Cryptanalysis There’s new benchmark measuring AI’s ability to perform mathematical cryptanalysis. Anthropic’s frontier model actually...
Z.ai pitches GLM-5.2 for long-running software engineering tasks
“Western enterprises will want independent benchmark validation, successful deployments at global enterprises, strong security and governance controls, and long-term support...
FIM Test: A Method for Distinguishing True FIM Capabilities in a Crowd of Claims
In a previous blog, we presented NIST’s benchmark definition of integrity monitoring. The conclusion was clear: Many vendor claims...
