CLUSTER · TIER 3
Hugging Face adds benchmaxxer repellant to Open ASR Leaderboard
Hugging Face has introduced anti-gaming measures dubbed 'benchmaxxer repellant' to its Open ASR Leaderboard, aimed at preventing models from being optimized specifically to score well on the benchmark rather than reflecting real-world performance. The update is intended to improve the integrity and reliability of automatic speech recognition evaluations on the platform.
Sources
1
X mentions
—
First seen
1Dago
Velocity
+4%/6h