Free tool

Indexability checker — can this URL be indexed?

Quick answer: paste a URL and get one verdict from every on-page signal that can block indexing — status, robots meta, X-Robots-Tag, canonical, redirects and whether there is content in the HTML.

Five vetoes, any one of which is enough

A URL is eligible for indexing when all of these hold: it answers with a 200, robots.txt permits the crawl, no noindex appears in either the meta tag or the X-Robots-Tag header, its canonical does not nominate a different URL, and there is content in the HTML worth storing.

They are vetoes rather than a score. Four green rows and one red one means not indexable, and the red row is the whole answer.

Eligible is not indexed

This is the distinction that matters most and disappoints most. Passing every check means nothing is blocking the page. It does not mean the page will be stored, because indexing is a judgement about whether it is worth storing relative to everything the engine already has.

A technically flawless page on a domain with few referring domains can sit in discovered, currently not indexed indefinitely. No on-page change moves it. That is an authority problem wearing a technical costume, and recognising which one you have saves weeks.

The two quiet blockers

X-Robots-Tag does not appear in view-source. It is set at the server or CDN and it can apply to a whole path, which is how a directory gets excluded by a rule nobody remembers writing.

A canonical pointing elsewhere blocks nothing and still keeps the page out of results, because you asked the engine to consolidate onto a different URL. Intended behaviour, frequent surprise.

When Search Console disagrees with this tool

Search Console reports the last crawl. This reads the page now. If you removed a noindex an hour ago, the two will disagree for days and this one is right. Request indexing and wait rather than changing anything else.

For the crawl-permission side, the robots.txt tester; for the full on-page picture, the SEO report generator.


Frequently asked questions

What actually decides whether a page can be indexed?

Five things, and any one of them can veto: the URL must answer with a 200 rather than an error or a redirect, robots.txt must allow the crawl, the page must not say noindex in either a meta tag or an X-Robots-Tag header, its canonical must not point at a different URL, and there has to be content in the HTML worth storing. This checks all of them except robots.txt, which has its own tool.

Does passing this mean the page will be indexed?

No. It means nothing is blocking it. Indexing is a decision about whether the page is worth storing, made against everything else the engine already has. An eligible page on a domain with little authority frequently sits in the discovered-not-indexed state indefinitely, and no on-page change fixes that.

Why does Search Console say my page is excluded by noindex when I removed it?

Because the report reflects the last crawl, not the current state. After removing a noindex, request indexing for the URL and expect a lag of days. If this tool says the directive is gone and Search Console still reports it, the page is fine and the report is stale.

Can a canonical stop a page being indexed?

It can stop THAT URL being the indexed one. A canonical pointing elsewhere tells the engine to consolidate onto the target, so the page you checked may never appear even though nothing blocked it. That is the intended behaviour and a common surprise.

Does a redirect make a page unindexable?

The redirected URL is not indexed; its destination is. That is normally what you want. It is only a problem when a URL you meant to be a landing page turns out to redirect, which is worth checking on anything you link to in advertising or email.

What about pages behind a bot challenge?

A challenge page returns its own content and often its own status. If the word count here is tiny and the title looks unfamiliar, you are probably reading the challenge rather than the page, and so is the crawler.


All free tools

SEO Title Generator & Checker

Generate SEO titles from your keyword and check any title's character count, pixel width, and keyword position.

Meta Description Generator & SERP Preview

Generate high-converting meta descriptions and preview how your page looks in Google.

Keyword Density Checker

Paste any text and see keyword density, top 1–2–3-word phrases, and stuffing warnings.

Robots.txt Generator (AI-Crawler Aware)

Generate a correct robots.txt in seconds.

LSI & Related Keyword Generator

Generate related keywords, question keywords, and commercial long-tails from any seed term.

Image Alt Text Generator & Checker

Build descriptive, SEO-friendly alt text for product images and check existing alt text for length, redundancy, and stuffing.

Googlebot Simulator — See What Google Sees

Fetch any URL with Googlebot's user agent: status code, redirects, title, meta robots, canonical, X-Robots-Tag, H1s, and an indexability verdict.

Schema markup generator

Generate valid JSON-LD schema free: Product, FAQPage, BreadcrumbList, LocalBusiness and Article.

Hreflang tag generator

Build a valid hreflang cluster for every language version of a page, with x-default, and a built-in check that every URL points back at every other one..

UTM builder

Build consistent UTM-tagged campaign URLs free.

URL slug generator

Turn any title into a clean, lowercase, hyphenated URL slug.

Readability checker

Paste text and get Flesch Reading Ease, Flesch-Kincaid grade level, sentence length distribution and the specific sentences that are dragging the score down..

SERP preview tool

Preview how a title, URL and meta description will render in Google on desktop and mobile, measured in pixels rather than characters so truncation is accurate..

SEO ROI calculator

Estimate what a ranking improvement is worth: search volume, position-based CTR, conversion rate and order value, plus a payback period on your SEO spend..

Open Graph generator

Generate Open Graph and Twitter card meta tags with a live preview of how the link will look when shared on Facebook, LinkedIn, X, WhatsApp and Slack..

SEO report generator

Generate an on-page SEO report for any URL: title and meta lengths, headings, canonical, schema types, image alt coverage, links and indexability, scored..

Redirect checker

Follow any URL hop by hop: every status code, every intermediate URL, and the page that finally answers.

Robots.txt tester

Fetch any site robots.txt and test a path against Googlebot, Bingbot, GPTBot, ClaudeBot and PerplexityBot.

Sitemap checker

Fetch any XML sitemap or index and check it: URL count against the 50,000 limit, lastmod coverage and honesty, size and reachability..

HTTP header checker

Fetch any URL as Googlebot and read the full response headers, with the SEO-relevant ones called out: X-Robots-Tag, Cache-Control, Content-Type, Vary and HSTS..

AI visibility checker

Check what AI answer engines may do with a site: GPTBot, ClaudeBot, PerplexityBot and Google-Extended rules, llms.txt, and whether pages are quotable..

hreflang checker

Read the hreflang cluster on any page: every declared alternate, whether the page includes itself, whether x-default is present, and whether the codes are valid..

Canonical checker

Check the canonical on any URL: present or missing, self-referencing or pointing elsewhere, and whether a redirect or noindex contradicts it..

Heading structure checker

Check the heading structure of any page: how many H1s, whether levels are skipped, and how many sections a reader or an answer engine can actually navigate..


Related guides

Run this across your whole catalog

RankEngine applies and verifies these fixes on every product in your Shopify store — automatically.

Install RankEngine free