• deegeese@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    1
    ·
    16 days ago

    Optimizing AI performance by “scaling” is lazy and wasteful.

    Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.

    • NoiseColor @lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      16 days ago

      Thing is, same as with GHz, you have to do it as much as you can until the gains get too small. You do that, then you move on to the next optimization. Like ai has and is now optimizing test time compute, token quality, and other areas.