livenerf: does a frontier model get quietly worse after launch?
Pre-registered 30-day benchmark series · 1.5K GitHub stars · running since September 2026
A daily, append-only benchmark that tests the "model nerf" claim. A locked panel of 78 GPQA, MMLU-Pro, competition-math and AIME questions, chosen because the model only sometimes gets them right, is rerun every day against a 10-day launch baseline. The design, the detectable effect size and every deviation were published before the results.
Code Discord