You published a page, waited, searched – and it is nowhere to be found. Before worrying about rankings, confirm the basics: a page must be indexed before it can appear in search results at all.
This guide walks through the most common reasons Google does not index a page, in the order worth checking.
First: confirm whether it is indexed
The reliable way is Google Search Console’s URL Inspection tool. Paste the URL and it tells you whether the page is on Google, when it was last crawled, which canonical Google chose and why it might be excluded.
A quick rough check is a site: search, such as site:example.com/blog/my-post, though results are not always complete.
1. A noindex directive
A noindex tag explicitly tells search engines to leave a page out:
<meta name="robots" content="noindex">
It can also be sent as an HTTP header (X-Robots-Tag: noindex), which is invisible in the page source. Common causes: a CMS setting such as WordPress’s “Discourage search engines” option, an SEO plugin setting on a post type, or a staging configuration that went live.
Find out whether Google can crawl and index a page – and if not, exactly why.
2. Blocked by robots.txt
If robots.txt disallows the URL, Google cannot crawl it. It may still occasionally index the bare URL from links, but without content it will not rank. Remove or narrow the Disallow rule.
3. The page returns an error or redirect
Only pages that return 200 OK are indexed. Pages returning 404, 410, 5xx errors or redirects will not be. Intermittent server errors can also cause pages to drop out.
4. A canonical pointing elsewhere
If the page’s canonical tag points to another URL, Google will usually index that URL instead. Search Console reports this as “Alternate page with proper canonical tag”. Make sure pages you want indexed have self-referencing canonicals.
Check a page’s canonical URL, whether it resolves, and if it conflicts with other signals.
5. Duplicate without a chosen canonical
“Duplicate without user-selected canonical” or “Duplicate, Google chose different canonical than user” means Google sees the page as a copy of another. Make the content distinct, consolidate the duplicates with redirects, or set canonicals consistently.
6. Discovered – currently not indexed
Google knows the URL exists but has not crawled it yet. This often happens on new or large sites, and can indicate Google does not consider the URLs a priority. Help by:
- Adding internal links from important, frequently crawled pages
- Including the URL in your sitemap
- Improving server speed so Google can crawl more
- Reducing the number of low-value URLs competing for attention (filters, parameters, thin pages)
7. Crawled – currently not indexed
Google fetched the page and decided not to index it – at least for now. This is usually a quality or value judgement. Ask:
- Does this page offer something not already available on your site or elsewhere?
- Is the content thin, auto-generated or largely copied?
- Is it a near-duplicate of other pages on your site?
Improving and expanding the content, merging similar pages and strengthening internal links are the usual fixes. Requesting indexing repeatedly will not override a quality decision.
8. Soft 404
A soft 404 is a page that returns 200 but looks like an error or empty page – for example, a product page saying “out of stock, no information”, an empty category or a redirect to an irrelevant page. Either add useful content or return a real 404/410.
9. The content depends on JavaScript
If the main content only appears after JavaScript runs, Google has to render the page before it can see it. Rendering can be delayed, and script errors can hide content entirely. Check that your important content is present in the raw HTML, or use server-side rendering.
See how much of a page is in the raw HTML versus loaded by JavaScript.
10. Orphan pages
A page that no other page links to is hard for Google to find and suggests it is not important. Link to it from relevant pages and categories.
11. The site is new or has little authority
New sites with few external links are crawled less often, and Google may index only a portion of their pages at first. Focus on a smaller number of strong pages, earn some genuine links and mentions, and indexing typically broadens over time.
12. Manual actions or security issues
Rarely, a manual action (for spam) or a security issue (hacked content, malware) causes pages to be removed. Check the Manual actions and Security issues reports in Search Console.
A troubleshooting checklist
- Inspect the URL in Search Console and read the exact status
- Check for noindex in the HTML and headers
- Test the URL against robots.txt
- Confirm it returns 200 without redirects
- Check the canonical tag
- Confirm the content is in the raw HTML
- Make sure the page is linked internally and in the sitemap
- Honestly assess whether the content is unique and useful
- Fix the issue, then use Request indexing in URL Inspection
How long should you wait?
New pages on established sites are often indexed within days. On new sites it can take several weeks. If a page is still not indexed after a few weeks despite passing all technical checks, the issue is usually discovery (not enough internal links) or perceived value.
Diagnosing indexing at scale
When many pages are not indexed, look for patterns rather than checking URLs one by one:
- Open Search Console’s Page indexing report and note the largest “Why pages aren’t indexed” categories.
- Click into each reason and look at example URLs. Are they all from one section, template or URL pattern?
- Filter by your sitemap to focus on URLs you actually want indexed.
- Crawl the affected section to check status codes, canonicals, noindex tags and word counts together.
Common patterns:
- All blog posts excluded by noindex → a template or plugin setting
- Thousands of parameter URLs as duplicates → faceted navigation without canonical or crawl controls
- Most product pages crawled but not indexed → thin, manufacturer-supplied descriptions repeated across many sites
- New pages stuck in discovered – not indexed → weak internal linking or slow server
Improving pages that are crawled but not indexed
When Google has seen a page and decided not to index it, technical fixes alone will not help. Ask what would make the page genuinely worth including:
- Add unique value: original information, specific details, examples, images or data that other pages do not have
- Consolidate: if several thin pages cover similar ground, merge them into one comprehensive page and redirect the rest
- Remove: if a page has no realistic value for searchers (tag pages with one post, empty categories), noindex or delete it
- Strengthen signals: link to the page from relevant, important pages so its importance is clear
After improving a page, request indexing and give it a few weeks.
Indexing for new websites
Brand-new sites often see only some pages indexed at first. Speed things up by:
- Verifying the site in Search Console and Bing Webmaster Tools and submitting a sitemap
- Launching with a smaller number of strong, complete pages rather than hundreds of thin ones
- Making sure every page is linked from the homepage or a category page
- Earning a few genuine links – a listing on relevant directories, partner sites, local press or industry associations
- Publishing consistently, so crawlers learn the site updates regularly
Checking indexing without Search Console
If you do not have access to Search Console – for example when analysing a competitor – a site: search for the exact URL gives a rough indication, and an indexability check confirms whether anything technical prevents indexing. Search Console remains the only authoritative source for your own site.
Key takeaways
- Use Search Console’s URL Inspection tool to see exactly why a page is not indexed.
- Check technical blockers first: noindex, robots.txt, status codes and canonical tags.
- Make sure important content is in the raw HTML and the page is linked internally.
- “Crawled – currently not indexed” is usually about value – improve, merge or remove thin pages.
- Look for patterns across many URLs; most indexing problems come from templates and settings.
- Request indexing after fixing a problem, then give Google time to recrawl.
Frequently asked questions
Does “Request indexing” guarantee indexing?
No. It asks Google to crawl the page sooner. Google still decides whether to index it.
Why did indexed pages drop out?
Common reasons are a new noindex or canonical issue, server errors, duplicate content consolidation, or Google re-evaluating the quality of thin pages after a core update.
Is it normal for some pages not to be indexed?
Yes. Every site has pages Google chooses not to index, such as duplicates and low-value URLs. What matters is that your important pages are indexed.
Does submitting a sitemap fix indexing problems?
A sitemap helps discovery, but it cannot overcome noindex tags, blocking, canonical issues or low quality.
Check your own site
Run a free audit with 55+ checks and get a fix for every issue.