webfetch-mcp-server
webfetch-mcp-server is a web data fetching server built in Rust. This project aims to facilitate efficient data collection, allowing for integration with APIs and automated data retrieval. Leveraging Rust's characteristics, it achieves fast and secure data processing.
GitHub Stars
0
User Rating
Not Rated
Favorites
0
Views
22
Forks
0
Issues
0
webfetch-mcp-server
Overview
A Rust-based MCP server that provides a fetch tool for retrieving the content of a web page by URL via the MCP protocol.
Features
- Simple web page downloader
Getting Started / Usage
Create .devcontainer/devcontainer.json as follows:
devcontainer.json
This is a minimal devcontainer configuration required to use this repository as an MCP server.
Place the following file at .devcontainer/devcontainer.json in your project.
Note:
This is a sample configuration.
Thecargocommand is required for installation and is available in the specified devcontainer image.
This configuration allows you to quickly set up a development environment for the webfetch-mcp-server using Visual Studio Code and the Dev Containers extension.
After opening your project in VS Code, select Dev Containers: Reopen in Container from the Command Palette to start developing inside the container.
{
"image": "mcr.microsoft.com/devcontainers/rust:1-bullseye",
"postCreateCommand": "cargo install --git https://github.com/arapower/webfetch-mcp-server.git"
}
MCP Client Settings in VSCode
You can configure the MCP client in VSCode by creating .vscode/mcp.json.
Below are sample configurations for each type.
For type: "stdio"
{
"servers": {
"webfetch": {
"type": "stdio",
"command": "webfetch"
}
}
}
webfetchruns as an MCP server using standard input/output.
For type: "http"
{
"servers": {
"webfetch-api": {
"type": "http",
"url": "http://host.docker.internal:8040/mcp"
}
}
}
webfetch-apiconnects to the MCP server via HTTP at the specified URL.
Example Usage of the fetch Tool
From an MCP client, send a request like the following:
{
"url": "https://example.com"
}
You will receive the content of the web page.
Build Errors
Depending on your build environment, you may encounter errors if the OpenSSL development package is missing.
This error occurs because the Rust dependency crate openssl-sys cannot find the OpenSSL development libraries (such as header files and .pc files) on your system.
You can resolve this by installing the OpenSSL development package using the following commands:
Ubuntu/Debian:
sudo apt-get update sudo apt-get install pkg-config libssl-devFedora/RHEL:
sudo dnf install pkg-config openssl-develArch Linux:
sudo pacman -S pkgconf openssl
Troubleshooting / FAQ
Q:
webfetchcommand not found
A: Please runcargo install --git https://github.com/arapower/webfetch-mcp-server.gitinside the Dev Container.Q: Cannot connect from MCP client
A: Check if thecommandsetting inmcp.jsonis correct and ensure the server is running.
License
MIT
Acknowledgments & References
echokit_server is a high-performance server software built in Rust, offering efficient data processing and API management. Designed for developers, it boasts high scalability and adaptability for various applications. It is particularly well-suited for real-time data processing and microservices architecture.