crawlability

Roxy SEO: an open-source agent skill and PI extension for SEO, AEO, GEO, AI search visibility, technical audits, structured data, and content strategy.

Universal Agent Skill for safely preparing, auditing, launching, and troubleshooting any public website for search-engine discovery, crawlability, indexing, Schema.org site identity, Google 搜索 Console, and Bing Webmaster Tools.

Ruby sitemap generator for Rails apps with deterministic XML, validation, and IndexNow/搜索 Console pinging

A framework-agnostic reference for handling faceted navigation without wrecking crawl budget: a five-tier classifier (index / canonicalize / noindex / robots-block) driven by one facet registry, with sitemap, robots.txt, and parameter normalization.

AI 搜索 Readiness & Web Discoverability Toolkit — Analyze how well websites are prepared for AI-powered search engines

Inspect crawler-facing HTTP, indexability, sitemap, structured-data and migration evidence from inside WordPress.

llms.txt validator CLI and GitHub Action for AI visibility, GEO/AEO, AI SEO, sitemap/robots alignment, and AI crawler readiness.

Google 搜索 Console indexing checklist for crawlability, sitemap, robots.txt, canonical tags, noindex issues, redirects, 404 errors and technical SEO fixes.

Local-only robots.txt and sitemap.xml validation for AI coding agents

Description: Technical SEO audit checklist and report template for crawlability, indexing, sitemap, robots.txt, PageSpeed, Core Web Vitals, schema and website health.

Deterministic CI for technical SEO. Prove that sitemaps, canonicals, robots directives, redirects, internal links, hreflang, and indexability signals agree before deployment.

Google robotstxt: Reference parser/matcher robots.txt, близкий к поведению Googlebot.

Audit robots.txt and sitemap XML for crawlability, sitemap discovery, blocked important paths, broken URL limits, and SEO-safe indexing basics.

Ruby sitemap crawler for Rails SEO audits with metadata, JSON-LD, uniqueness, link checks, and structured issues