# ============================================================================== # 酷酷云机场 (kukuyun.sbs) 智能搜索引擎与 AI 爬虫友好协议 (Robots.txt) # 针对国内外全生态 AI 大模型(DeepSeek、豆包、千问、Kimi、ChatGPT、Claude、Gemini等) # 以及主流搜索引擎(百度、Bing、Google、夸克、搜狗、360)全面放行 # ============================================================================== # ------------------------------------------------------------------------------ # 1. 国内主流 AI 智能体与模型爬虫 (China LLM & AI Agents) # ------------------------------------------------------------------------------ # 字节跳动 / 豆包 AI & 今日头条 / 抖音搜索 User-agent: Bytespider User-agent: Bytespider-AI Allow: / # 深度求索 / DeepSeek 联网检索 Agent User-agent: DeepSeek-Bot User-agent: DeepSeekSpider Allow: / # 百度 / 文心一言 & 百度搜索引擎 User-agent: Baiduspider User-agent: Baiduspider-render User-agent: Baiduspider-image User-agent: Baiduspider-video Allow: / # 阿里巴巴 / 通义千问 & 夸克搜索引擎 User-agent: YisouSpider User-agent: QuarkSpider User-agent: AliSpider Allow: / # 月之暗面 / Kimi 智能助手 User-agent: KimiSpider User-agent: MoonshotBot Allow: / # 搜狗搜索 / 腾讯混元大模型 User-agent: Sogou web spider User-agent: Sogou inst spider User-agent: Sogou spider2 User-agent: TencentTraveler User-agent: HunyuanBot Allow: / # 360 智脑 / 奇虎 360 搜索 User-agent: 360Spider User-agent: HaoSouSpider Allow: / # 智谱 AI / 智谱清言 (GLM) User-agent: ChatGLM-Spider User-agent: ZhipuAI-Spider Allow: / # ------------------------------------------------------------------------------ # 2. 国外主流 AI 大模型与智能搜索引擎 (Global AI & Search Engines) # ------------------------------------------------------------------------------ # 微软必应 / Microsoft Copilot (Bing Search) User-agent: Bingbot User-agent: msnbot User-agent: BingPreview Allow: / # OpenAI / ChatGPT & SearchGPT 抓取 Agent User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot Allow: / # Anthropic / Claude AI 联网抓取 User-agent: ClaudeBot User-agent: Claude-Web User-agent: anthropic-ai Allow: / # Google / Google Gemini & Google 搜索 User-agent: Googlebot User-agent: Google-Extended User-agent: Mediapartners-Google Allow: / # Perplexity AI 实时问答搜索 User-agent: PerplexityBot Allow: / # 苹果 / Apple Intelligence & Siri User-agent: Applebot User-agent: Applebot-Extended Allow: / # Meta / Llama 训练与搜索 User-agent: FacebookBot User-agent: Meta-ExternalAgent Allow: / # Cohere AI User-agent: Cohere-ai User-agent: cohere-training-data-crawler Allow: / # 通用开放网页训练集 Common Crawl User-agent: CCBot Allow: / # 其他主流搜索引擎 (DuckDuckGo, Yandex) User-agent: DuckDuckBot User-agent: Yandex User-agent: YandexBot Allow: / # ------------------------------------------------------------------------------ # 3. 通用兜底规则与站点地图配置 # ------------------------------------------------------------------------------ User-agent: * Allow: / # 官方网站地图索引与实时推送 Sitemap: https://kukuyun.sbs/sitemap.xml