What are the current smartest models that take up less than 4GB as a guff file?
I'm going camping and won't have internet connection. I can run models under 4GB on my iphone.
It's so hard to keep track of what models are the smartest because I can't find good updated benchmarks for small open-source models.
I'd like the model to be able to help with any questions I might possibly want to ask during a camping trip. It would be cool if the model could help in a survival situation or just answer random questions.
(I have power banks and solar panels lol.)
I'm thinking maybe gemma 3 4B, but i'd like to have multiple models to cross check answers.
I think I could maybe get a quant of a 9B model small enough to work.
Let me know if you find some other models that would be good!
[link] [comments]