inference-gateway
An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
GitHub Stars
56
User Rating
Not Rated
Favorites
0
Views
29
Forks
7
Issues
5
Technical Information
Programming Languages
GoPrimary Language
System Requirements
No specific requirements are documented
Maintenance Status
ActiveGitHub Topics
agnosticanthropicapicoheredeepseek-v3gatewaygateway-apigolanginference-apikubernetesllmopenaiopensourceopensource-projectsopentelemetryperformanceproxyproxy-serverself-hostedtracing
Author Information
An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers
Germany
6
Followers
20
Repositories
0
Gists
0
Total Contributions