I made this android app which runs ai models locally

I wanted to add link on this post but wasn't able to , cause it was either photos or the link that's why I gave the photos ,

If you need link just ask for link.

​

​

Few months ago I wanted to try running ai models on my phone and I was trying to find few apps ,but i couldn't find a decent one

​

- Some were giving handpicked models

- Some restricted downloads of model based on my device config

- Experienced not being smooth

- Background download was not supported

- etc etc

​

​

​

So i made one , Features :::---

​

- Can run any GGUF || LiteRT models

​

​

- has 3 ways of adding model to models list

-> Downloading from recommended handpicked list of models for not knowing user

-> Downloading from in app Hugging Face integration

-> Importing gguf & LiteRt models from your device's internal storage

​

​

​

- Two backend available ( cpu , vulkan )

-> You must set the preference to vulkan if you want to set gpu layers in settings.

​

​

​

- You can set system prompt( for setting personas or telling the model how to behave )

- Can modify inference parameters

​

​

​

- And this is just the first version.

-> A new feature will be coming soon which will just make it the bbbbbest ( won't say what it is now )

​

​

( Download will continue even after you close your app , thus you must cancel the download manually if your want to )

​

​

​

​

My device Config -

Ram - 4gb ( max free - 1.4-1.6 on good days)

Rom - 64gb

Os - Android 10

​

All screenshots are from this device

​

And neither this text nor the application is vibe coded ,( ai autocomplete is used , but that's it)

​