MyIPScan
Live crawlability report

AI/Search Visibility Scanner

Check whether a public page can be crawled, indexed, and discovered by search engines and AI search systems based on visible technical signals.

The scanner combines HTTP status, redirects, robots.txt, bot-specific rules, noindex, canonical, sitemap sampling, server-rendered content, llms.txt, and conflict detection. It does not promise ranking or AI citations.

Result first Safe Copy after scan Bot matrix below
Safe Copy keeps the crawlability story clean. It keeps findings and fixes while redacting raw headers, bot-policy payloads, tokens, exact sensitive values, and oversized technical dumps. See the safe sharing model.

Before interpreting resultsCrawlability limits
Crawlable is not the same as indexed.

The report separates robots.txt crawl access, page-level noindex, canonical hints, sitemap discovery, and content signals.

AI search is not AI training.

AI search crawler tokens and AI training or provider-specific tokens are shown separately so policy decisions stay clear.

Diagnosis first

AI/Search Visibility Estimate

Safe report available after scan.

Preparing your report...

Copy the safe version when you share this result. Safe Copy keeps search and AI visibility findings useful without carrying raw headers or crawler-policy payloads into a public thread.

Search and AI summary

Visibility Status

Search, AI search, and training/access policy are separate.

Top issues

What needs attention

Maximum five issues are shown here.

Next steps

Recommended Fixes

Prioritized for website, CMS, and SEO owners.

Crawler policy

AI/Search Bot Matrix

Default rows stay readable. Advanced rows are collapsed.

Technical details

Checks

Collapsed by default.

Share safely

Copy Actions

Use Safe Copy before sharing results.

Safe Copy keeps the finding summary and recommended fixes while redacting raw headers, raw bot-policy payloads, tokens, and exact sensitive values.

Limits

What this tool does not prove

Clear limits keep the result useful.

This is a technical visibility estimate based on public crawl/indexing signals. It is not a guarantee of Google indexing, search ranking, ChatGPT visibility, Claude visibility, Perplexity visibility, AI citations, or crawler compliance.

  • robots.txt controls crawling guidance, not guaranteed indexing removal.
  • noindex works only if the crawler can access the directive.
  • A crawlable page can still be excluded, ignored, rewritten, or ranked poorly.
  • llms.txt is optional and not a universal ranking standard.
  • This scanner does not execute JavaScript, crawl the full site, read server logs, or connect to Search Console, Bing Webmaster Tools, Cloudflare, OpenAI, Anthropic, Perplexity, or private analytics.

Monitoring coming next

Search and AI crawler policy changes are planned

Monitoring will compare robots.txt, Googlebot access, noindex, canonical, sitemap inclusion, llms.txt, and AI crawler policies so important visibility changes can be reviewed first. Alerts are planned, but they are not live yet.

  • Googlebot became blocked
  • noindex appeared
  • canonical or sitemap changed
  • AI crawler policy changed
Run full report

Focused tools

Use these when one signal needs deeper detail.