This was supposed to be an article comparing three major AI players in their ability to write technical articles. In preparation, however, I made some mistakes ... :(
When I prepared for the initial article, I asked them to fetch the data from*
https://github.com/gabr42/ComputeCor...omputeCore.pas and write about it. (See the end of this article for the initial
query and results.) At that moment, however, that link was not public yet. All three AIs ignored that and happily wrote about the code they knew nothing about. It was only Claude that complained about the bad link but I missed that while checking the results.*
So I decided to rerun the experiment on all platforms. I started by asking the engines the following question:*
Can you accesss
https://github.com/gabr42/ComputeCor...omputeCore.pas and provide an overview of the code in one paragraph?
This worked with ChatGPT but both Claude and Gemini complied that they cannot
access the link. I had to rerun the
query with the link to the raw file for the latter two to work:
Can you accesss
https://raw.githubusercontent.com/ga...omputeCore.pas and provide an overview of the code in one paragraph?
Analyzing the answer shows that the answers were not done purely on the basis of the linked code. Both Claude and Gemini have included details that they got from my previous article on
ComputeCode.
In the answers below I marked hallucinated misinformation with red*and information that was obviously retreived from different sources with blue.
Read more »[SIZE=-2]--- Published under the
Creative Commons Attribution 3.0 license[/SIZE]
Weiterlesen...