inference-gateway
An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
GitHub Stars
56
User Rating
Not Rated
Favorites
0
Views
30
Forks
7
Issues
5
Installation
Difficulty
IntermediateEstimated Time
10-20 minutes
Additional Resources
Author Information
An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers
Germany
6
Followers
20
Repositories
0
Gists
0
Total Contributions