Chatbots don’t help programmers summarized an article from Bertrand Meyer.
Meyer suggests that an AI programming assistant as “a cocky graduate student, smart and widely read, also quick to apologize, but thoroughly, invariably, sloppy and unreliable”.
A lot of people suggest that using an AI chatbot as an assistant might not result in a correct program, but that it would give a starting point that a good programmer can fix.
Most of the examples I see proving this depend on having the chatbot generate code in a language or style that the experimenter does not know. This gives an illusion that it can help generate code more quickly than the developer would have. Unfortunately, if you don’t know the language/framework you are generating, your ability to evaluate the code suffers from the Dunnig-Kruger effect.
Meyer sums up the problem here well with:
What use do I have for a sloppy assistant? I can be sloppy just by myself, thanks, and an assistant who is even more sloppy than I is not welcome.”
Bertrand Meyer