What it does
-
What a crawler can read
Shows the page content as it comes from the raw HTML, so you can see what's left when JavaScript never runs — which is what a lot of crawlers end up working with.
-
Structured data and metadata
Lists the schema.org data, title, description, and heading structure the page hands to machines.
-
AI bot rules
Reads robots.txt and the page's own directives so you can see which AI crawlers your site allows and which it turns away.
-
Page by page
Run it on whatever page you're on — a product page, an article, a landing page — instead of reasoning about the site as a whole.
Questions people ask
Does this tell me whether ChatGPT or another assistant will cite my page?
No. It shows what your page exposes to a crawler. Whether any given assistant fetches it, indexes it, or cites it is that assistant's decision, and none of them publish the rules.
Which AI crawlers does it cover?
The AI crawler user agents commonly named in robots.txt files. The set changes as new ones appear, so treat the list as current practice rather than a complete registry.
Why does the content look different from what I see in the browser?
Because the extension shows what's in the page before your browser runs JavaScript. If your content is rendered client-side, a crawler that doesn't execute scripts sees the emptier version.
Should I block AI crawlers?
That's your call — the extension only shows you what your current rules do. Worth knowing: AI crawler directives are separate from regular search crawler directives, so blocking one doesn't automatically block the other.
Do I need to add anything to my site to use it?
No. It reads pages as they are already served — no tag, no script, no verification step.
Also from WrongOrbit
-
Add Signature to PDF
Draw your signature, embed it into any PDF
-
Flip & Rotate Video
Mirror or rotate any YouTube video, right in the player
-
Web Accessibility Checker
Check any page against WCAG, right where you are