As an example: I was doing a search for the best sesame substitute today. Everything that came up was things like, "11 Best Sesame Substitutes," and I know for a fact that just about everything they suggested tastes nothing like sesame. Just another site trying to get hits. So I added reddit.com into my search parameters and immediately got some decent answers.

I really hate that I have to do that to get anything useful, but there is a ridiculous amount of useful information on Reddit. I hope the fediverse gets to this point as well one day.

Anway, just needed to vent. Lemmy on.

    • Diabolo96@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      4
      ·
      edit-2
      1 year ago

      Yes, every LLM ate reddit but LLMs aren’t aren’t reliable and tend to hallucinate .

      On the other hand, one could train an / (ask a big enough) AI to extract useful info from each post, sort it in big categories (life style, science, mechanic,etc ) and subcategories (life tips, male clothe tips, chemistry, animal facts , car engine repair, bike engine repair ) then Do an internet search to check if there are other sources and use it to judge the reliability of the info and put it in a database that the LLM look up before answering. This condensed reddit could likely hold on a few gigs. Maybe there’s a better way to do it but this is the extent of my very limited knowledge.

        • Diabolo96@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          2
          ·
          1 year ago

          Bing does extract info from sites, including reddit and compare it to other sources but i doubt they’re creating a database. Imagine all the wisdom, knowledge of hundreds of thousands of people but offline and only without the useless arguing and other bullshit.