• BigFig@lemmy.world
      link
      fedilink
      English
      arrow-up
      26
      arrow-down
      1
      ·
      1 year ago

      What do you do when ChatGPT just makes shit up or answers incorrectly to yes or no questions, you’d have no way of knowing it was wrong

    • thorbot@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 year ago

      I’m curious what you use it for, because I try to use it daily for IT related queries and it gets less than half of what I ask correct. I basically have to fact check almost everything it tells me which kind of defeats the purpose. It does shine when I need really abstract instructions though, the other day I asked it how to get into a PERC controller on some old server and Google had nothing helpful, and ChatGPT laid out the instructions to get in there and rebuild a disk perfectly. So while it has some usefulness I generally can’t really trust it fully.

      • Womble@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        1 year ago

        The point you have to remember is that it is trained on bulk data out there in a very inefficient manner, it needs to see thousands of examples in order to start getting any sort of understanding of something. If you ask it “how do I do {common task} in {popular language}” you will generally get excellent results, but the further you stray from that the more likely to be error prone it is.

        Still it is often good to get you looking on the right track when you are unsure to start, and is fantastic for learning a new language. I’ve been using it extensively in learning C# where I know what I want to code but not exactly how to use existing features to do it.

      • cybersandwich@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        5
        ·
        edit-2
        1 year ago

        But generally you can’t (shouldn’t) trust web search results fully either. At the end of the day, the onus is on you as the user to do your due diligence.

        I’ve seen ChatGPT give me wrong information, and sometimes it would be bad to execute the code or command it generated it, but I know enough to say “are you sure thats correct?”. Hell, you can just challenge it each time or open a new session and ask it “what does this code do: insert-code-it generated here”.

        You shouldn’t just paste a search result command from stack overflow into your terminal either. And at least with chatgpt you can ask it to explain the command or code in detail and it will walk you through what each step does.

        Also, pasting that command from stack over flow into chatgpt and adding your specific context around it is HUGE. Thats why I say they are different products/use cases but they work well in concert. They just dont work well combined together like bing and google have been doing.

        edit: I guess lemmy escapes certain characters and it ate my post.

    • jacktherippah@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      1 year ago

      ChatGPT is not a search engine. It takes random shit from the Internet and stitches it together. It can often get things wrong in my experience. It’s best to always fact check.

    • Supervisor194@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      2
      ·
      1 year ago

      I use ChatGPT every day too. Because Google is being such a shit about YouTube I am in the process of moving away from Google altogether. I use DuckDuckGo for search, which indirectly uses Bing. It’s mostly OK. Sometimes I’m forced to try Google, it usually doesn’t help. But for programming, yeah, StackOverflow feels downright regressive now.

      I’m honestly kind of surprised about this news, considering how horrible Google’s results are now.

    • eran_morad@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I prefer that stack looks the same as it did way back when. And stack is usually where i find my answers.