AI Coding Tools Underperform in Field Study with Experienced Developers

3 comments

• manveerc 11 hours ago
  I believe it’s the same study where developers were new to the coding tools, the one developer who had some experience actually saw a significant boost in productivity.
• DANmode 12 hours ago
  Experienced in...development?

  or experienced managing humans (and therefore agents/LLMs)?

  Probably your differentiating factor.
• deterministic 7 hours ago
  30+ years of experience here and I am definitely more productive using AI. However I don't think it is more than maybe 5% to 10%.

  I think a Google study showed a 10% improvement at Google?