Ask HN: Model Sycophancy Benchmarks?

Model sycophancy is going to become a major issue for individuals and society... Do any benchmarks exist for this? Really needs to become a standard aspect of model quality measures

2 points | by gradus_ad 3 hours ago

1 comments

  • muddi900 2 hours ago
    I think we should design a "Bullshit Benchmark" that tests for sycophancy and fluff like Opus 5 "two X, but only Y matters" color commentary