AI benchmarks have a trust problem and Google wants to fix it
- Google: 12 events in the last 90 days
- Previous: earlier the same day · Marvell Technology shares slump as investors question Google deal. Here’s what Wall Street is saying.
What happened
Google Deepmind is testing a double-blind evaluation of a frontier AI model for the first time. Cryptographic protection through Confidential Space is meant to keep Google from seeing the test questions and keep evaluators from seeing the model weights. The pilot project with the Singapore AI Safety Institute uses a Gemini Flash Lite and could set a new standard for tamper-proof AI benchmarks.
Summary assembled by rule from the sources below