• AbelianGrape@beehaw.org
    link
    fedilink
    arrow-up
    2
    ·
    9 hours ago

    This is definitely true for code but in terms of information retrieval and explaining complex topics, they have gotten much better in the sense that they can cite real sources (with links) now.

    The analysis and synthesis that they do of those sources is still often bogus though. I’ve had one explain some simple Magic the Gathering rules with real-looking words but completely bogus interpretations and conclusions, but it did cite the correct rulebook with a link. I’ve also had one give a pretty strong overview of the construction and underlying theory of a particular compiler (a specific compiler, not the language it compiles) that matches up quite well with my own fairly deep understanding of that compiler.

    Overall the real information is better, but the hallucinations look more real too. And they’re still pretty unhelpful for programming in my experience.

    • megopie@beehaw.org
      link
      fedilink
      English
      arrow-up
      1
      ·
      7 minutes ago

      A marginal improvement for a limited use case.

      Not a revolutionary jump forward in capability. not a trillion dollar industry that justifies this level of investment or obsession.