R

FastAPI-BitNet provides a robust REST API for managing and interacting with llama.cpp-based BitNet model instances. It is designed for developers and researchers to programmatically control automated testing, benchmarking, and interactive chat sessions. Key features include session management, batch operations, and model benchmarking capabilities.

An extension for running BitNet in VSCode via Model Context Provider endpoints.