Skip to content

SEO and AI search visibility

Write the meta tags, robots.txt, sitemap and llms.txt a site needs, and check what AI crawlers are allowed to read. Extract a page's metadata, convert it to clean Markdown, detect its tech stack and score how readable its docs are.

10 tools, free, in your browser

Meta Tag Generator & Previewer

Generate SEO meta tags with live Google, Facebook, and Twitter card previews

Generators

robots.txt Generator & Validator

Generate robots.txt with per-bot Allow and Disallow rules, crawl-delay, sitemap URLs and AI crawler blocks like GPTBot, or validate an existing file.

Generators

Sitemap.xml Generator

Generate a sitemap.xml from absolute URLs with optional lastmod, changefreq and priority, skipping invalid lines and warning past 50,000 URLs.

Generators

llms.txt Generator

Generate an llms.txt file with an H1, summary blockquote and Markdown link sections, or validate an existing one for structure and absolute URLs.

AI tools

LLM Crawl Policy Validator

Validate robots.txt and llms.txt files, detect conflicts, simulate AI bot access, and export corrected policies

AI tools

RSS Feed Validator

Validate RSS/Atom XML and preview feed entries with parser diagnostics

Developer utilities

URL Metadata Extractor

Extract OG tags, canonical URLs, meta descriptions, and JSON-LD from pasted HTML

Developer utilities

Web-to-Markdown Converter

Convert pasted HTML or a fetched URL to Markdown for LLM input, dropping scripts, navigation and footers, and estimate the token savings.

AI tools

Website Tech Stack Detector

Detect website frameworks and platforms from pasted HTML, headers, and script URLs

Developer utilities

AI Doc Readability Scorer

Score Markdown docs on structure, code examples, API discoverability, schema coverage, LLM parseability and readability, with fixes ranked by impact.

AI tools

More collections