AI 搜索就绪度
AI 爬虫访问
为何重要
AI search engines such as ChatGPT search, Claude and Perplexity need their crawlers to be allowed in robots.txt to read and cite your pages. Training crawlers are separate and can be blocked without affecting search.
如何修复
- Allow AI search crawlers (OAI-SearchBot, Claude-SearchBot, PerplexityBot) in robots.txt if you want to be cited.
- Decide separately whether to allow training crawlers such as GPTBot or Google-Extended.
使用以下工具检查
- AI Search Readiness Checker – Check if ChatGPT, Claude, Perplexity and Google AI can access, read and quote your page.
- Robots.txt Generator – Build a robots.txt file with sitemap, blocked folders and AI crawler controls.
评分：通过的检查获得全部权重，警告获得一半，错误则不得分。 SEO 评分如何运作