AI coding tools may not speed up every developer, study shows

software engineer’s workflow has been transformed in recent years by flowing artificial intelligence coding tools such as the indicator and GitHub Copilot, which promises to enhance productivity by writing code lines automatically, installing errors, and test changes. The tools are operated with artificial intelligence models from Openai, Google DeepMind, HotHROPIC and Xai, which have increased their performance rapidly in a set of engineering tests for programs in recent years.

However, a new study published on Thursday by the Non -profit artificial intelligence group calls Metr to what extent to which the tools of artificial intelligence are strengthened today the productive day of experienced developers.

Metr conducted a random experience governed by this study by employing 16 open source of source and making them complete 246 real tasks on large code warehouses in which they contribute regularly. The researchers assigned nearly half of these tasks randomly as “AI-Lebored”, giving developers permission to use modern artificial intelligence coding tools such as Cursor Pro, while the other half of the tasks prevents the use of artificial intelligence tools.

Before completing the tasks allocated to them, developers expected that the use of artificial intelligence coding tools would reduce the time of completion by 24 %. This was not the case.

The researchers said: “It is surprising that we find that allowing the sponing organization actually increases the 19 % completion time – developers are slower when using artificial intelligence tools.”

It is worth noting that only 56 % of the study developers have experience in using the index, which is the main artificial intelligence tool provided in the study. While almost all developers (94 %) have experience in using some web -based LLMS in their coding function, this study was the first time that some indicator was used specifically. Researchers note that developers have been trained to use the index in preparation for study.

However, the results of Metr raises questions about the supposed global productivity gains promised by artificial intelligence coding tools in 2025. based on the study, developers should not assume that artificial intelligence coding tools – specifically what is known as “programmers” – will immediately accelerate their work.

Metr researchers refer to some possible reasons that make Amnesty International slow down the developers instead of accelerating them.

First, developers spend more time to push artificial intelligence and wait for response when programmers use elegance instead of actually coding. Artificial intelligence also tends to struggle in the rules of large and complex software instructions, which this test used.

The authors of the study are keen not to extract any strong conclusions of these results, noting that they do not believe that artificial intelligence systems are currently failing to accelerate or most of the program developers. Other extensive studies have shown that artificial intelligence coding tools accelerate the software engineer.

The authors also notice that the progress of artificial intelligence has been great in recent years, and that they do not expect the same results even three months from now. Metr also found that artificial intelligence coding tools have greatly improved their ability to complete the complex long horizon tasks in recent years.

However, the research provides another reason to be skeptical of the promised gains of artificial intelligence coding tools. Other studies have shown that today’s artificial intelligence coding tools can make mistakes, and in some cases, security weaknesses.