I’ve just discovered OmniGPT that seems to be a chat where you can interact with different LLM (Claude, GPT-4, Llama, Gemini, etc.) and costs $16/month (it was $7/month until a week ago 🤦♂️). I’ve read on a Reddit post that it uses the APIs of all the provider that is a thing that can be done for free using a personal account (since the API limit seems to be high). Do you know something like OminGPT that can be self hosted that uses users API keys?
I think KoboldAI Lite is what you’re asking for. I’m not sure how it works, but it seems to be able to use OpenAI, Claude, Gemini, Horde and OpenRouter.
I think this is the repo for the website: https://github.com/LostRuins/lite.koboldai.net
The website is a bit ugly.