Piloting the world's first double-blind AI evaluations

Google DeepMind announces a pilot for double-blind AI evaluations using cryptographic environments to prevent benchmark contamination. The initiative partners with Singapore AI Safety Institute and others to test Gemini Flash Lite. This describes a new evaluation methodology and pilot program. No usable software, model weights, or developer tools are released for public use.