Beware of ChatGPT and company: it will never admit that it does not know an answer

ChatGPT and its limitations

When we all expected that Web 3.0 as the next great advance on the Internet, appeared the already very famous Chat GPT that it has come to take away the crown of "saint" from Google, to the point that in Alphabet they have activated the "red code" so as not to lose their dominant position. Right now, there are many of us who, instead of searching with a normal search engine, ask ChatGPT, either directly or indirectly, but you have to be careful what you do with the answers because they are not always accurate.

When you talk to anyone who has used ChatGPT frequently in the last few weeks, you realize that they think that it's a good tool, but it is more so if you know the subject you are talking about. In other words, if you don't know anything about the subject in question, you can sneak in incorrect information, and even waste time, since it seems that you haven't been programmed modest enough to respond with "I don't know"; he always answers, and he always does so with authority, as if he can't be wrong. And it is not like that.

ChatGPT only goes until September 2021

Although it also makes use of other means, the historical database of ChatGPT It only comes to September 2021. I recently chatted with this AI to discuss song lyrics. Looking at what he had on my kodi, I asked him about several, one of them Avalanche, Avril Lavigne, 2022. He told me he didn't know that letter, and it surprised me. I asked him about when the next Metallica album was going to come out and I started to "freak out": he mentioned S&M2 to me, and he said it was exciting, but that album came out in 2020, not even in 2021 anymore. From the information you have, you should have answered something else.

I started to tell him that he was wrong, and to keep in mind that even though he knows what date it is, his database goes all the way to 2021, like that, like a slap on the wrist, and there was no way for him to recognize that he was committing a mistake. mistake. Or yes, he apologized for the misunderstanding, but then he gave me the same answer again; He has no idea that 72 Seasons is coming out in April, and it's on the Wikipedia and all over the internet. And about the song Avalanche, he insisted that it was from the album Head Above The Water, from 2018; I put it on a wrong record, I don't know, to say the least, and he didn't realize the contradiction of telling me that he doesn't know a song and at the same time which record it appears on, doing it wrong, of course.

And be careful with the code

The best thing he does is help with the code, but he doesn't always get it right there either. Sometimes it gives you answers that may work, but are not what you are looking for. Here it seems that asking the question as precisely as possible comes into play, but you always have to say something. I recently asked him about something that wasn't happening in a piece of code I wrote, and after we've spent over an hour trying things out, I replay the code that he had at the beginning, and he told me I was missing a command or command.

And I say, if I told him the same "I have this", why didn't he give me the correct answer the first time? I think the explanation is that he has to say something fast that seems correct, even though there are better options. It is true that in the end he found the solution, but it made me waste my time doing tests that were not necessary. Probably, examining the conversation, he found the error, but for me it would have been better if he took his time in the first answer and everything would have been faster.

Other times you can say "would this work?" and it answers yes, providing you with a code that is not exactly the one you have given it. I asked him about a SQL query for SQLite, he told me that it would work, and then he gave me the code adding some parentheses at the end that I forgot. I told him, that then he should have told me no, that it was not going to work because I had forgotten the parentheses, and at that moment he apologized for having omitted the parentheses and gave me the same corrected answer again, but because I have pointed out the error before.

ChatGPT and company need to improve

It is clear, or it seems to me, that all this is here to stay. That the way we look for things and even do jobs is changing and will change even more, but it has to improve. In fact, they already warn about this in the "Limitations" section of ChatGPT, but who reads the terms of use and all these things? The human being wants things, and he wants them now. Well, in terms of information, dress me slowly because I'm in a hurry, right now nothing is perfect.

The content of the article adheres to our principles of editorial ethics. To report an error click here.

2 comments, leave yours

Leave a Comment

Your email address will not be published. Required fields are marked with *



  1. Responsible for the data: AB Internet Networks 2008 SL
  2. Purpose of the data: Control SPAM, comment management.
  3. Legitimation: Your consent
  4. Communication of the data: The data will not be communicated to third parties except by legal obligation.
  5. Data storage: Database hosted by Occentus Networks (EU)
  6. Rights: At any time you can limit, recover and delete your information.

  1.   Sergio from Argentina said

    While it's certainly a great tool for getting information, some things seem to make you dizzy. For example, I asked him something about the Argentine soldier Mohamed Seineldin and he answered me about the soldier Aldo Rico. When I mentioned the error, he told me that he did not have that information about the businessman (instead of a soldier) Seineldin. I asked him which were the best and worst neighborhoods in Buenos Aires and he replied that all neighborhoods should be treated with respect. He also told me that there was nothing to suggest that the repressor of the dictatorship, Ramón Camps, was an anti-Semite (Ramón Camps was famous for his anti-Semitism).

    1.    Robert said

      I asked him a minute ago and he answered me this: Mohamed Alí Seineldín (1933-2009) was an Argentine soldier and politician, known for his participation in two military uprisings against the democratic government in Argentina.

      Seineldín was born in the city of Roque Sáenz Peña, in the province of Chaco. He graduated from the Escuela Militar de la Nación in 1956 and later served in the Argentine Army, participating in the Malvinas War in 1982.

      In 1987, Seineldín led an attempted coup against the government of President Raúl Alfonsín, in protest of the government's economic policies and human rights policy. The attempt failed and Seineldín was arrested and sentenced to prison.

      In 1990, he was released by an amnesty from President Carlos Menem and returned to the army. In 1991, he led another military uprising known as the "Carapintada", this time against President Menem. Again, the attempt failed and Seineldín was arrested and sentenced to prison for sedition and rebellion.

      After his release in 2003, Seineldín became a controversial figure in Argentine politics, advocating for the intervention of the military in politics and the implementation of nationalist policies. In 2009, Seineldín died in a traffic accident in the province of Buenos Aires.

      Seineldín remains a controversial figure in Argentina, being admired by some as a defender of the rights of war veterans and a symbol of resistance against corrupt governments, while others see him as a coup plotter and violator of democracy.

      How come he answered you otherwise?