• loathsome dongeater@lemmygrad.ml
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 month ago

    Generally speaking would people want to run it on their own personal hardware? Or are there VPS-like services which allow people to run their own models?

    • burlemarx@lemmygrad.ml
      link
      fedilink
      arrow-up
      3
      ·
      1 month ago

      For sure there are VPS services available for this. However, it’s sad how much we need a powerful rig with 32GB RAM just to do regular development or test new FOSS stuff these days (for the sake of being melodramatic).