AI Researchers Beat Humans in Alignment Task
The story in brief
Anthropic Fellow Chen Yueh-Han led a study showing AAR systems can improve alignment benchmarks without degrading performance. Compared to humans, AARs are cheaper, faster, and more effective. The best AAR method outperformed experienced researchers within six hours. AARs cost $4/hour vs. $150/hour for humans. They improved performance on all 10 tested benchmarks, proving reliability and scalability.