Check if your pages can be indexed by Google
Free indexability checker. Find accidental noindex tags and X-Robots-Tag headers, robots.txt rules that block Google, missing sitemaps, off-site canonicals and broken pages.
A single noindex tag left over from a staging environment can remove a whole site from Google. This checker finds that and the other common technical causes of pages not being indexed.
What this checker tests
<meta name="robots" content="noindex">andX-Robots-Tag: noindex, on the homepage and crawled pages- robots.txt presence and rules that block all crawlers
- XML sitemap discovery via robots.txt or
/sitemap.xml - Canonical tags that point to another domain
- Missing and duplicate titles, missing meta descriptions
- Internal pages that return errors
Read the full checklist: Why is my page not indexed?
Checks included
| Check | Severity | How to fix |
|---|---|---|
| Homepage is set to noindex Search engines are told not to list your homepage, so it will disappear from Google. | critical | Remove "noindex" from the robots meta tag or X-Robots-Tag header (often a leftover "discourage search engines" setting from staging). |
| Some pages are set to noindex These pages will not appear in search. Fine if intentional (e.g. thank-you pages), harmful if not. | low | Review the listed pages and remove noindex from any that should rank. |
| robots.txt blocks search engines from the whole site "Disallow: /" for all crawlers or Googlebot stops search engines from crawling any page. | critical | Remove "Disallow: /" from robots.txt (common leftover from development). |
| robots.txt is missing Not fatal, but robots.txt is where crawlers look for your sitemap and rules. | low | Add a robots.txt with "User-agent: *", "Allow: /" and a Sitemap: line. |
| No XML sitemap found Sitemaps help search engines discover and refresh your pages faster. | low | Generate /sitemap.xml (most CMSs and frameworks can) and reference it in robots.txt. |
| Pages without a <title> The title is the main headline in search results. | medium | Give every page a unique, descriptive <title> (about 50–60 characters). |
| Titles longer than 65 characters Long titles get cut off in search results. | info | Shorten titles to roughly 50–60 characters, most important words first. |
| Duplicate page titles Identical titles make pages compete with each other and confuse searchers. | low | Write a unique title for each page. |
| Pages without a meta description Search engines will invent a snippet, which is often less compelling. | low | Add a unique meta description (about 140–160 characters) to each important page. |
| Canonical tags point to another domain You are telling Google the "real" page lives elsewhere, so these pages may not rank. | medium | Point canonical tags to the page's own URL on your domain. |
| Broken internal pages (4xx/5xx) Broken links waste crawl budget and frustrate visitors. | medium | Fix or redirect the listed URLs, and update links that point to them. |
| Homepage has no mobile viewport tag Without it, phones render a zoomed-out desktop page, which hurts mobile rankings. | low | Add <meta name="viewport" content="width=device-width, initial-scale=1">. |
| Homepage <html> has no lang attribute The lang attribute helps screen readers and search engines understand the page language. | info | Add e.g. <html lang="en">. |
This free tool runs the full passive Wardzo scan and shows these checks first. Nothing is stored in full: secrets are masked, and anonymous reports are deleted after 30 days.
Frequently asked questions
What is the difference between noindex and robots.txt Disallow?
Disallow stops crawlers from fetching a page. Noindex lets them fetch it but tells them not to show it in results. If a page is disallowed, Google cannot see its noindex tag.
Does this replace Google Search Console?
No. Search Console shows what Google actually indexed. Wardzo catches the technical causes early, often right after a deploy.
Related
- Why is my page not indexed? A noindex and robots.txt checklist
A step-by-step checklist for pages missing from Google, covering noindex tags, X-Robots-Tag headers, robots.txt blocks, canonicals, sitemaps and server errors.
- What does noindex mean?
Noindex is a directive in a robots meta tag or X-Robots-Tag header that tells search engines not to show a page in search results.
- What is robots.txt?
robots.txt is a text file at the root of a website that tells crawlers, including search engines and AI crawlers, which paths they may fetch.