SEO Tools

Robots Meta Tag Checker

Inspect the robots meta tag and X-Robots-Tag HTTP header of any public URL. Identifies noindex, nofollow, noarchive, noodp, nosnippet, and max-snippet directives that control crawler behaviour.

Free SEO analysis No sign-up required Instant results

Audit your robots meta directives

Fetch any live URL and instantly audit meta name="robots", meta name="googlebot", and X-Robots-Tag headers — so you know exactly what search crawlers see.

Never stored meta robots · googlebot X-Robots-Tag header Conflict detection 10+ directives
Robots Directive Builder

Toggle directives to generate the correct robots meta tag. Red = blocking directives.

<meta name="robots" content="index, follow">
X-Robots-Tag: index, follow
Paste HTML Paste the <head> section or full page source

Features

  • Reads meta name='robots' content from the page HTML
  • Checks X-Robots-Tag HTTP response header
  • Identifies noindex, nofollow, noarchive, nosnippet directives
  • Shows raw directive values for each
  • Flags pages that may be unintentionally blocked from indexing
  • Fetches public URLs only, SSRF-protected

How to use it

  1. Enter a public page URL in the input.
  2. The tool fetches the HTML and HTTP headers.
  3. Robots directives are displayed and explained.
  4. Review any flagged issues.

Use cases

  • Checking if a page is accidentally marked noindex
  • Auditing robots meta tags before a site migration
  • Verifying robots directives after CMS changes
  • Diagnosing why a page is not appearing in search results

Limitations

  • Only public URLs can be analysed. Pages behind authentication cannot be fetched.
See also

Related tools

seo

SEO URL Inspector

Audit any public URL for SEO issues. Checks meta title, description, H1-H6, Open Graph, robots directives, canonical URL, and schema markup in one report.

Use tool
seo Browser

Canonical URL Checker

Check the canonical URL tag on any public page. Verifies rel=canonical presence, self-referencing, and cross-domain canonicals. Browser-only.

Use tool
seo Browser

Headings Checker

Extract and analyse the H1–H6 heading structure of a page or HTML snippet. Check for missing H1, duplicate H1s, and heading hierarchy issues. Browser-only.

Use tool
seo Browser

SERP Preview

Preview how your page title and description will appear in Google search results. Check character limits and see mobile and desktop previews side by side.

Use tool
seo Browser

Meta Title Checker

Check a meta title against SEO best practices. See character count, pixel width estimate, keyword presence, and SERP preview. Browser-only.

Use tool
seo Browser

Meta Description Checker

Check meta descriptions against SEO best practices. Character count, pixel width, keyword check, and SERP preview. Browser-only, free.

Use tool
Questions & answers

Frequently asked

What is the difference between robots.txt and robots meta tags?

Robots.txt controls crawler access to URLs. The robots meta tag controls indexing and link-following of crawled pages. A page can be crawlable but not indexed.