mcp-llms-txt-explorer
The MCP LLMS.txt Explorer is a server designed for exploring and analyzing websites that implement llms.txt files. This tool helps discover compliant websites and provides access to structured data. It features website validation and listing capabilities, making it a valuable resource for developers.
GitHub Stars
66
User Rating
Not Rated
Favorites
0
Views
36
Forks
14
Issues
2
Node.js: 18.0.0以上pnpm: 最新版Installation
Installation
Prerequisites
Please specify required software and versions:Installation Steps
1. Clone Repository
bash
git clone https://github.com/thedaviddias/mcp-llms-txt-explorer.git
cd mcp-llms-txt-explorer
2. Install Dependencies
bash
pnpm install
3. Build the Server
bash
pnpm run build
4. Configure Claude Desktop
Editclaude_desktop_config.json to add the MCP server:
json
{
"mcpServers": {
"llms-txt-explorer": {
"command": "node",
"args": ["/path/to/llms-txt-explorer/build/index.js"]
}
}
}
5. Start Server
bash
pnpm start
Troubleshooting
Common Issues
Issue: Server won't start Solution: Check Node.js version and reinstall dependencies. Issue: Not recognized by Claude Desktop Solution: Verify configuration file path and syntax.Configuration
Configuration
Basic Configuration
Claude Desktop Setup
Edit~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or
%APPDATA%\Claude\claude_desktop_config.json (Windows):
json
{
"mcpServers": {
"llms-txt-explorer": {
"command": "node",
"args": ["/path/to/llms-txt-explorer/build/index.js"]
}
}
}
Environment Variables
Set the following environment variables as needed:bash
export API_KEY="your-api-key"
export DEBUG="true"
Advanced Configuration
Security Settings
Performance Tuning
Configuration Examples
Basic Configuration
json
{
"mcpServers": {
"llms-txt-explorer": {
"command": "node",
"args": ["/path/to/llms-txt-explorer/build/index.js"]
}
}
}
Examples
Examples
Basic Usage
Here are basic usage examples for the MCP server:Using with Claude Desktop
Available tools from this MCP server:
- check_website: Check if a website has llms.txt files
- list_websites: List known websites with llms.txt files
Programmatic Usage
javascript
// JavaScript example (Node.js)
const { MCPClient } = require('@modelcontextprotocol/client');
const client = new MCPClient();
await client.connect();
// Execute tool
const result = await client.callTool('check_website', {
domain: 'example.com'
});
console.log(result);
Advanced Examples
Automation Script
bash
#!/bin/bash
Batch processing example
for file in *.txt; do
mcp-tool process "$file"
done
API Integration
python
Python example
import requests
import json
def call_mcp_tool(tool_name, params):
response = requests.post(
'http://localhost:3000/mcp/call',
json={
'tool': tool_name,
'parameters': params
}
)
return response.json()
Usage example
result = call_mcp_tool('list_websites', {})
Use Cases
Additional Resources
Building digital products under David Dias Digital. I create tools, apps, and experiments that solve real problems — one project at a time.
4,762
Followers
98
Repositories
103
Gists
0
Total Contributions
NPM Helper is a tool designed to assist with npm package management, providing features for updating dependencies and searching for packages. It allows for safe upgrades of a project's package.json, ensuring that dependencies are updated to the latest compatible versions without conflicts. This tool enhances efficiency in managing project dependencies while minimizing errors.
Shrimp Task Manager is a task tool built for AI Agents, emphasizing chain-of-thought, reflection, and style consistency. It converts natural language into structured dev tasks with dependency tracking and iterative refinement, enabling agent-like developer behavior in reasoning AI systems.