Hello folks:
A majority of the local clients I've tried from compiled binaries or via GitHub repos are buggy. Thus, I'm on the hunt for a local or web client that I can access ChatGPT via my API keys but also link to Pinecone or other embeddings. Obviously I also want to ensure that the key and data in the embeddings are secure, regardless of a local or web client.
anything-llm was my go-to, but it's got some hiccups.
FWIW, running a local model, even with a 4070, just doesn't give me the results I need consistently. Thus, I'll continue to pay a few bucks for OpenAI Chat GPT API access until the scene improves.
Thanks!
[link] [comments]