Ҳамжамият
polite-crawler
io.github.mark1russell7/polite-crawler
A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.
Тавсиф асл тилда
Улаш
Конфигурацияни мижоз созламаларига қўшинг. <Бурчак қавслар> ичидаги қийматларни ўзингизникига алмаштиринг.
claude_desktop_config.json
{
"mcpServers": {
"polite-crawler": {
"command": "npx",
"args": [
"-y",
"polite-crawler@0.1.0"
],
"env": {
"POLITE_CRAWLER_DIR": "<POLITE_CRAWLER_DIR>",
"POLITE_CRAWLER_CONTACT": "<POLITE_CRAWLER_CONTACT>",
"POLITE_CRAWLER_ALLOW_PRIVATE": "<POLITE_CRAWLER_ALLOW_PRIVATE>",
"POLITE_CRAWLER_ALLOW_USER_PROVIDED": "<POLITE_CRAWLER_ALLOW_USER_PROVIDED>"
}
}
}
}Маълумотлар
- Номи
- io.github.mark1russell7/polite-crawler
- Версия
- 0.1.0
- Янгиланган
- 13 окт, 2026
- Манба
- Расмий MCP Registry
- Репозиторий
- https://github.com/mark1russell7/crawler