Create a free account Sign in

Audit

SEO audit Crawler AI Visibility Site vs Site

Research

Keyword Explorer Is it down? All SEO tools76

Tools

What do you want to do?

Get my pages into GoogleImprove a page that does not rankMake my website fasterFind keywords and write contentGet found in AI searchCheck if my site is downSecure my domain and emailSet up a new website
On-page SEO11
Meta Tags AnalyzerSERP Snippet PreviewHeading Structure CheckerImage Alt Text CheckerOpen Graph & Social Preview CheckerStructured Data ValidatorCanonical Tag CheckerLink AnalyzerHreflang CheckerFavicon CheckerAccessibility Checker
Technical SEO11
Full Site Audit (Crawler)Robots.txt TesterXML Sitemap CheckerRedirect CheckerBulk HTTP Status CheckerHTTP Headers CheckerBroken Link CheckerIndexability CheckerMobile-Friendly CheckerJavaScript SEO CheckerCookie & Tracker Scanner
Speed & performance11
Page Speed TestCore Web Vitals CheckerServer Response Time (TTFB) TestPage Size CheckerGzip & Brotli Compression TestHTTP/2 & HTTP/3 CheckerCSS MinifierJavaScript MinifierImage Compressor & WebP ConverterHTML MinifierWebsite Carbon Calculator
Content & keywords8
Keyword Density CheckerKeyword Suggestion ToolWord CounterReadability CheckerText to HTML Ratio CheckerURL Slug GeneratorCase ConverterDuplicate Content Checker
Generators10
Meta Tag GeneratorRobots.txt GeneratorSchema Markup GeneratorOpen Graph GeneratorXML Sitemap GeneratorRedirect Generator (.htaccess & Nginx)Hreflang Tag GeneratorUTM Campaign URL Builderllms.txt GeneratorFavicon Generator
Domain & security14
SSL Certificate CheckerSecurity Headers CheckerDNS LookupWHOIS / Domain LookupDomain Age CheckerMixed Content CheckerWebsite IP & Hosting LookupPing Test – Is the Website Up?Website Technology CheckerSPF, DKIM & DMARC CheckerDNS Propagation CheckerBlacklist CheckerWebsite Uptime MonitorOpen Port Checker
AI search & AI writing11
AI Search Readiness CheckerAI Title & Meta Description GeneratorAI FAQ & Schema GeneratorAI Content Brief GeneratorAI Content OptimizerAI SEO Page ReviewerAI Search Intent & Page MatchAI Competitor Content GapAI Content DetectorAI Alt Text GeneratorAI Headline Generator

Learn

SEO guides SEO issue guide Pricing

Preferences

Theme

Full Site Audit (Crawler)

Crawl a whole website to find broken pages, duplicate titles, missing tags and thin content.

Without an account you can crawl up to 25 pages. Create a free account for up to 50 pages.

About the Full Site Audit (Crawler)

A single-page check shows what is wrong with one URL. A site audit crawls your website the way Googlebot does – starting at the homepage, following internal links and reading your XML sitemaps – and finds problems that only show up across many pages.

Every crawl checks 150+ issue types in 19 groups: status codes and soft 404s, redirect chains and loops, canonical errors (chains, loops, targets that are broken or noindex), hreflang return links, sitemap URLs that redirect or fail, orphan pages, duplicate and near-duplicate content, titles, descriptions and headings, broken external links and images, page speed signals, security headers, structured data, social tags, accessibility and AI-search readiness.

Page Explorer lets you filter every crawled URL with your own rules (for example indexable = yes AND words < 300). Link Explorer shows every link with its anchor, position (navigation, content, footer) and target status. You also get anchor-text distribution, site sections, and internal link opportunities: pages that mention another page's topic but don't link to it yet. With Google Search Console connected, crawled pages also show clicks, impressions and position, plus pages that earn impressions but have no internal links.

Custom rules let you include or exclude URL patterns, cap click depth and ignore query strings. Everything exports to CSV.

Frequently asked questions

How many pages can I crawl?

Up to 50 pages per crawl on the free plan, 1,000 on Pro and 5,000 on Agency. Pages are discovered from internal links on the homepage outward and from XML sitemaps, so the most important pages are usually crawled first.

What are internal link opportunities?

Pages on your site that already mention the main topic of another page (taken from its title, H1 or top Search Console query) without linking to it. Adding those links helps search engines understand and rank the target page.

Will the crawl slow down my site?

No. The crawler fetches only a few pages at a time and stops at the page limit, which is far lighter than normal visitor traffic.

Why were some pages not found?

Standard mode follows normal HTML links and sitemap URLs. Where JavaScript rendering is available, it can also discover links added after the page renders. Pages behind forms, search boxes or robots.txt restrictions may still be unavailable.

Related tools