FastAPI-BitNet

FastAPI-BitNet provides a robust REST API for managing and interacting with `llama.cpp`-based BitNet model instances. Designed for developers and researchers, it allows programmatic control of automated testing, benchmarking, and interactive chat sessions. Key features include session management, batch operations, and model benchmarking.

GitHub Website Docs

GitHub Stars

User Rating

Not Rated

Favorites

Views

Forks

Issues

Reviews & Ratings

No reviews yet

Post Review

No reviews yet

Be the first to review this MCP and help others with useful information!

Write the first review

Author Information

Full stack developer

GitHub

Followers

Repositories

Gists

Total Contributions

Tags

1-bit benchmarking bitnet docker fastapi inference llm model-context-protocol multi-chat perplexity python server-orchestration uvicorn

Related MCPs

utcp-mcp

128

All-in-one MCP server that can connect your AI agents to any native endpoint, powered by UTCP

Python

magg

Magg is a Python library designed to aggregate Machine Control Protocol (MCP) data. It streamlines the collection and management of data, offering functionalities that support various MCPs. Through an easy-to-use API, users can effortlessly manipulate MCP data.

Python

AGENTIX

AGENTIX is an automation tool built with Python, designed to enable users to efficiently execute specific tasks. With an intuitive interface and powerful features, it is accessible even to users with limited programming knowledge. It offers a wide range of functionalities, including task automation, data processing, and API integration.

Python