The reliable way to check whether a page is indexed is Google Search Console’s URL Inspection tool: paste in the page address and it tells you whether the URL “is on Google” and, if not, why. Some reasons need a fix (an accidental noindex tag, a robots.txt block, a server error). Others are normal and need nothing (a redirect, or a duplicate pointing to the right version). Even an indexed page isn’t guaranteed to appear for any particular search.
This guide walks through how to check, what each common reason means, and what to do about it. For the broader checklist, see our 30-minute SEO health check. If you haven’t set up Search Console yet, start with our guide to setting up Google Search Console for a small business website.
Crawled, indexed and showing are three different things
It helps to separate three ideas:
- Crawled: Google’s crawler has visited the page.
- Indexed: Google has stored the page and it is eligible to appear in results.
- Showing: the page actually appears for a given search, which depends on ranking.
Google’s own wording is careful here: “URL is on Google” doesn’t guarantee the page will appear in Search results, while “URL is not on Google” means it can’t appear at all (Search Console Help: URL Inspection tool, checked 2026-10-28). This guide is about the second case: pages that aren’t indexed.
Why a site: search isn’t a reliable check
Many people type site:yourwebsite.com into Google to see what’s indexed. It’s a quick rough look, but Google says the list “is not always exhaustive” and doesn’t necessarily return every indexed URL (Google Search Central: site: operator, checked 2026-10-28). A missing page in a site: search doesn’t prove it isn’t indexed, so confirm with URL Inspection.
How to check one page with URL Inspection
- Open Google Search Console and choose your website’s property.
- Paste the full page address into the search bar at the top.
- Read the headline result: URL is on Google or URL is not on Google.
- If it isn’t on Google, open the Page indexing section to see the reason.
- Click Test live URL to see what Google finds on the page right now.
The main result shows the most recently indexed version, not the live page. The live test fetches the page in real time, which is useful for checking a fix, but Google notes it doesn’t check every indexing condition and a valid live result doesn’t guarantee indexing (URL Inspection tool help).
How to check the whole site with the Page indexing report
For a site-wide view, open Indexing → Pages in Search Console. It groups URLs that aren’t indexed by reason.
Don’t aim for every URL to be indexed. Google says you “should not expect all URLs on your site to be indexed, only the canonical pages”; the goal is to get the canonical version of every important page indexed (Search Console Help: Page indexing report, checked 2026-10-28).
A practical way to use the report: write a short list of the pages that matter most (home, each service page, contact, key guides), then check each one is indexed. Ignore long lists of unimportant URLs unless something important is caught up in them.
Reasons that usually need fixing
URL marked ‘noindex’. The page tells Google not to index it, through a meta tag or an HTTP header. This often happens when a site is launched with a “discourage search engines” or “hide from search” setting still switched on, or when a template page was set to noindex. If you want the page indexed, remove the noindex and confirm with the live test (Page indexing report help).
Blocked by robots.txt. Your robots.txt file stops Google crawling the page. Two points catch people out. First, a blocked page can still be indexed without its content if other pages link to it (Google: introduction to robots.txt, checked 2026-10-28). Second, if you want a page out of Google, don’t block it in robots.txt: Google needs to crawl the page to see a noindex tag (Google: block indexing with noindex, checked 2026-10-28). If the page should be indexed, remove the block.
Server error (5xx). Googlebot couldn’t load the page, or the request timed out. Check with your host, and make sure security or firewall settings aren’t blocking Googlebot (Page indexing report help).
Soft 404. The page shows a “not found”-style message (or almost no content) but returns a normal success code. If the page is gone, return a real 404 or 410, or redirect it only to a relevant replacement; if it’s meant to exist, give it proper content (Google’s 404 guidance).
Blocked due to unauthorized request (401). The page needs a login. If the page is intended to be public, ask your site maintainer to check the access settings. Keep login protection on deliberately private staging, preview or account pages.
Not found (404) on a page that moved. A 404 is fine for a page you removed on purpose. If the content moved to a new address, add a permanent (301) redirect from the old URL (Page indexing report help).
Reasons that are usually fine
Page with redirect. The old URL redirects to another URL and normally isn’t indexed itself. The destination may or may not be indexed: inspect it separately. If the redirect is intended and the destination is correct, no change to the old URL is needed (Page indexing report help).
Alternate page with proper canonical tag. The page correctly points to another version as the main one. Nothing to do.
Duplicate without user-selected canonical. Google found near-identical pages and chose one itself. Use URL Inspection to see which URL Google picked. If it chose the right one, leave it. If not, mark your preferred version with a canonical tag or redirect, or make the pages substantially different (Page indexing report help).
Duplicate, Google chose different canonical than user. You declared one version as canonical, but Google picked another. Google treats redirects and canonical tags as strong signals and sitemap inclusion as a weak one, and decides duplicates based on content similarity (Google: consolidate duplicate URLs, last updated 2026-07-10, checked 2026-10-28). Check that your declared canonical really is the best and most similar version, and that your internal links point to it.
“Crawled – currently not indexed” and “Discovered – currently not indexed”
These two statuses can be confusing because they do not identify one specific fix.
- Discovered – currently not indexed: Google knows the URL exists but hasn’t crawled it yet. Google says it rescheduled the crawl, for example to avoid overloading the site.
- Crawled – currently not indexed: Google visited the page and chose not to index it for now. Google says it “may or may not be indexed in the future” and there’s no need to resubmit it (Page indexing report help).
These labels alone do not establish the cause for a particular URL. If an important page is stuck in one of these states, our recommendations (not Google rules) are:
- Make sure the page is linked from your main menu or from relevant pages, not only listed in a sitemap.
- Check it isn’t a near-copy of another page on your site, such as several location or service pages with only the name swapped.
- Make it clearly useful on its own: a direct answer to the question it targets, real detail and specific facts.
- Then wait. Small, new sites can take time to be crawled and indexed.
After you fix something
- For one page: use URL Inspection and click Request indexing. There’s a daily limit, and a request doesn’t guarantee the page will be indexed (URL Inspection tool help). Requesting the same URL repeatedly won’t speed things up.
- For a whole issue: after fixing all affected URLs in that issue, open the reason in the Page indexing report and click Validate fix. Google says validation “typically takes up to about two weeks, but in some cases can take much longer” (Page indexing report help). Validation is optional and does not guarantee indexing.
- For many pages: make sure your sitemap is up to date rather than requesting each URL separately.
What’s in your control, and what isn’t
In your control: removing accidental noindex tags and robots.txt blocks, fixing server errors and broken redirects, choosing clear canonical URLs, linking to important pages, and making each page useful and distinct.
Not in your control: whether and when Google crawls a page, whether it decides to index it, and where it ranks. Google says there is no test that can guarantee a page will be included in its index (URL Inspection tool help).