I'm finding it hard to understand the use cases for running AI models locally. I came across this repo today https://github.com/elder-plinius/OBLITERATUS which is meant to remove restrictions placed on cloud models. Hugging face has a bunch of models/model types you can download and run locally. Other than removing restrictions or having a non-chat based model (img gen or something), what are people actually doing running models locally?
Isn't getting a Claude or ChatGPT subscription just so much easier that setting up your own hardware? I can't imagine writing so many prompts in a day that it's actually worth it to buy a DGX Spark or Ryzen Halo.
[link] [comments]