ChatGPT answered incorrectly 52% of the time in the field of programming
Recent research results from Purdue University (USA) show that ChatGPT incorrectly answered up to 52% of questions related to computer programming.
Recent research results from Purdue University (USA) show that ChatGPT incorrectly answered up to 52% of questions related to computer programming.
The research was presented at the Computer-Human Interaction Conference taking place in Hawaii (USA) earlier this month. Researchers analyzed 517 programming questions on the Stack Overflow platform, then gave these questions to ChatGPT to analyze and provide answers.
The results showed that 52% of ChatGPT's answers contained false information and of those 77% of the answers were expressed in a lengthy and cumbersome manner. However, thanks to its 'easy to understand' and 'fluent' language style, ChatGPT's answer, despite giving a lot of wrong information, made it popular with 35% of survey participants.
The study also showed that in 39% of cases, programmers participating in the survey could not detect errors in ChatGPT's answers.
Research results from Purdue University have shown that the reliability of ChatGPT - the tool expected to create a breakthrough in the field of AI is worrying.
Currently, the race to create the most 'smart' and reliable chatbots is attracting the participation of technology giants such as Meta, Microsoft and Google.
Google's new AI-integrated search engine is also facing criticism for frequently providing false information from unreliable sources.
You've just finished reading the article "ChatGPT answered incorrectly 52% of the time in the field of programming" edited by the TipsMake team. You can save chatgpt-answered-incorrectly-52-of-the-time-in-the-field-of-programming.pdf to your computer here to read later or print it out. We hope this article has provided you with many useful tech tips and tricks. You can search for similar articles on tips and guides. Thank you for reading and for following us regularly.
- Is GitHub Copilot or ChatGPT better for programming?
- 4 ways to use ChatGPT to manage time
- How to Implement ChatGPT in Django
- 5 programming tasks that ChatGPT still can't do.
- Bit field in C
- Learn about ChatGPT-4o: Features, benefits and how to use it
- eQuiz - Multiple choice test on ASP
- time.h in C
- What is ChatGPT Pro? Is it worth it in 2026?
- If you haven't used ChatGPT's special tools, you're definitely missing out!
- Top ChatGPT prompts for HR
- Instructions for converting ChatGPT-5 to ChatGPT-4o
- eQuiz - Multiple choice test on Java Swing Practice
- OpenAI Officially Integrates GPT-4.1 into ChatGPT