AI 評価が新たな計算リソースのボトルネックに（19 分読）

AI evaluation costs have escalated, becoming a significant compute bottleneck comparable to or exceeding training costs, with some runs costing tens of thousands of dollars. The field faces uneven cost distributions across models and tasks, highlighting inefficiencies and the need for cost-effective approaches like standardized documentation and data reuse. Without addressing these issues, the evaluation process remains expensive, challenging equal access and hindering external validation in AI research.