AI Search Engines Are Confidently Wrong Too Often
www.seroundtable.com
A new study from Columbia Journalism Review showed that AI search engines and chatbots, such as OpenAI's ChatGPT Search, Perplexity, Deepseek Search, Microsoft Copilot, Grok and Google's Gemini, are just wrong, way too often. I have said this time and time again, when I see an AI Answer, at this point, I just skip over it because I know I cannot trust it and this proves that.

A new study from Columbia Journalism Review showed that AI search engines and chatbots, such as OpenAI’s ChatGPT Search, Perplexity, Deepseek Search, Microsoft Copilot, Grok and Google’s Gemini, are just wrong, way too often.

  • venotic@kbin.melroy.org
    104·
    1 day ago

    Then again, so has the search engines themselves been proven to be wrong, inaccurate and just plain irrelevant. I’ve asked questions in Google before about things I need to know in general about my state out of curiosity and it’s results always pull up different states that do not apply to mine.

    • TheFogan@programming.devEnglish
      202·
      1 day ago

      well that’s common, but the big thing is, you can see what you are working with. Big difference in at least knowing you need to try a different site when say

      Google: Law about X in state1

      Top result: Law about X in state3: It’s illegal

      Result 2 pages in: here’s a list of each page and whether law X is legal in your state… (State 1 legal)

      Versus chatgpt

      Is X legal in state1?

      Chatgpt: No

      • HacksawEnglish
        4·
        18 hours ago

        Narrator: it was legal in state 1

    • catloaf@lemm.eeEnglish
      121·
      1 day ago

      Yeah because you’re not supposed to ask search engines questions, you’re supposed to use keywords.