With AI costs and performance under a microscope, it’s only a matter of time until corps start asking if these things are worth it (both in usage costs and uncertainty around usage costs).
Cemented by yesterday’s WWDC, Apple has been the only of the big tech companies focused on local LLMs. They may be in for a big pay day if these local models can output comparatively well when compared to remote ones.
Apple can boast:
1. No usage costs. Buy your device and download your models.
2. Offline LLM use (this is overlooked)
3. Privacy first approach (files never leave your device).
4. First party support for custom models.
I don’t see how this isn’t a much better solution for corporations than what Claude is pushing.
I’m not including OpenAI here as they seem to be identifying themselves as the consumer AI solution. I don’t see most of OAI users buying $2000+ dollar devices to use high performing models.
[link] [comments]