Generally speaking would people want to run it on their own personal hardware? Or are there VPS-like services which allow people to run their own models?
For sure there are VPS services available for this. However, it’s sad how much we need a powerful rig with 32GB RAM just to do regular development or test new FOSS stuff these days (for the sake of being melodramatic).
People with 20+ gigs of ram who want to run local models?
Generally speaking would people want to run it on their own personal hardware? Or are there VPS-like services which allow people to run their own models?
For sure there are VPS services available for this. However, it’s sad how much we need a powerful rig with 32GB RAM just to do regular development or test new FOSS stuff these days (for the sake of being melodramatic).