#reliability
1 articles
- 2026-10-06
Pass@1 Is the Most Expensive Lie in AI
A model that succeeds once is not necessarily dependable. Repeated runs and longer tasks reveal the bill hidden behind pass@1.
1 articles
A model that succeeds once is not necessarily dependable. Repeated runs and longer tasks reveal the bill hidden behind pass@1.