Crawlability and Indexability: Audit Passing Checks Plus Site-Level Guidance (AI Studio Pro)
If search engines cannot crawl and index a page, nothing else matters. The Crawl & Index audit checks what it can verify on the page and gives you clear site-level guidance to confirm everything else.
What Crawl & Index does
It runs two kinds of checks. Page-level checks it can verify directly — noindex directive, link hrefs, internal links, heading uniqueness — and reports them as ok / warn / fail. Then it lists site-level guidance — canonical tags, robots.txt, XML sitemap, redirect chains — things that live outside the single page, with clear instructions to verify them on your site. It complements the on-page SEO and Optimise a Post work.
- Open the post in the Analyser Editor
- Run the Crawl & Index audit
- Read the passing page-level checks (ok / warn / fail)
- Review the site-level guidance
- Verify canonical, robots.txt, sitemap & redirects on your site
- Publish
Step-by-step
1Run the Crawl & Index audit
- Open the post in the Analyser Editor.
- Open the Crawlability & Indexability panel and run the audit.
A summary line like “4 ok · 0 warn · 0 fail · 8 guidance”, then the individual checks below it.
2Read the passing page-level checks
Each check the agent can verify shows a status and a short explanation — noindex directive (no accidental noindex), link hrefs (real, valid links), internal links (crawlers can discover related pages), and heading uniqueness.
3Follow the site-level guidance
Some things live outside the page, so the agent gives you guidance to verify on your site: a self-referencing canonical tag, a robots.txt that doesn’t block important pages or CSS/JS, a valid XML sitemap, and no redirect chains. Each item tells you exactly what to confirm.
4Publish
With the checks passing and the guidance confirmed, click Save & Publish. The publish window pre-fills the title, slug, meta and tags.
Tips
- Fix any fail first, then warn — these block or weaken indexing.
- Treat the guidance items as a checklist; verify them once per site, not per post.
- Make sure robots.txt isn’t blocking CSS/JS — it can hurt how pages are rendered and ranked.
- Keep one self-referencing canonical per page to avoid duplicate-content confusion.
FAQ
Why are some items “guidance” instead of pass/fail?
Those live at the site level (robots.txt, sitemap, redirects) and cannot be confirmed from one page, so the agent tells you what to verify.
What does the noindex check do?
It confirms there is no accidental noindex directive that would keep the page out of search results.
Does this replace a full technical SEO audit?
It covers the essentials per page plus a site-level checklist; for large sites, pair it with your own crawl tooling.
Run the Crawl & Index audit and work through the guidance. See the full Analyser Editor guide or the AI Studio Pro walkthrough.
Open AI Studio ProThe TechsGenius editorial team produces in-depth guides on digital marketing, SEO, personal finance, and AI tools. Every article is reviewed by certified marketing professionals and financial experts.
