Even with all the testing, the company said in its released research that the model tightened up once it was “aware” it was being evaluated. 

OpenAI and Anthropic said they turned over their models to government researchers, who found an array of previously undiscovered vulnerabilities and attack techniques.