AI-Generated Code Usually Needs Refactoring

Claude, Supermaven and Cursor users are much more likely to say they had a positive experience than users of other AI-based developer tools. Users of Google Gemini, JetBrains AI and Meta’s Llama are much less likely to report having a positive experience with those technologies.

These are just some of the many findings we uncovered in “The 2025 State of Web Dev AI” report. The report is based on more than 4,000 responses collected in February and March. Respondents were mostly web developers who had previously taken a survey about JavaScript, React and other topics conducted by Sacha Greif and the Devographics team.

Here are a few of takeaways we identified:

  • AI tools increase productivity. Fifty-nine percent agreed with that statement, compared to 20% who disagreed.
  • AI tools are regularly used. Sixty-nine percent use AI tools to generate or refactor code at least a few times a week.
  • Vibe coding is still in its infancy. Sixty-nine percent of respondents said that less than 25% of the code they produce is AI-generated.
  • AI-generated code requires refactoring. Seventy-six percent of developers have to rewrite or refactor at least half of the outputted code before it’s ready to be used. Poor readability, variable renaming, excessive repetition and code that doesn’t work were reasons cited about why refactoring is necessary.
  • Winners and Losers: Claude, Supermaven and Cursor users are much more likely to say they had a positive experience than users of other AI-based developer tools. Users of Google Gemini, JetBrains AI and Meta’s Llama are much less likely to report having a positive experience with those technologies.

The complete article can be found here.