Here are
37 public repositories
matching this topic...
Universal Agent Skill for safely preparing, auditing, launching, and troubleshooting any public website for search-engine discovery, crawlability, indexing, Schema.org site identity, Google Search Console, and Bing Webmaster Tools.
Updated
Aug 26, 2026
Python
A framework-agnostic reference for handling faceted navigation without wrecking crawl budget: a five-tier classifier (index / canonicalize / noindex / robots-block) driven by one facet registry, with sitemap, robots.txt, and parameter normalization.
Updated
May 24, 2026
Python
AI Search Readiness & Web Discoverability Toolkit — Analyze how well websites are prepared for AI-powered search engines
Updated
Apr 26, 2026
Python
Verificador de URL canonico e integridade de indexacao. Audita apontadores canonicos, prevencao de canibalizacao e normas W3C.
Updated
Nov 20, 2026
Python
Validateur et auditeur de Sitemaps XML et index d'URLs. Controle de syntaxe XML, plafonds d'URLs, lastmod et integrite d'indexation.
Updated
Nov 20, 2026
Python
XML Sitemap validator for Australian digital systems. Verifies XML syntax, URL capacities, lastmod dates, and search crawl hygiene.
Updated
Nov 20, 2026
Python
Validador y auditor de Sitemaps XML e indices de URLs. Comprobacion de sintaxis XML, limites de URLs, lastmod y directrices de rastreo.
Updated
Nov 20, 2026
Python
XML Sitemap validator for Canadian web platforms. Audits syntax, URL quotas, lastmod attributes, and search indexer crawl health.
Updated
Nov 20, 2026
Python
Robots.txt validator for Canadian web platforms. Audits User-agent rules, crawl directives, and sitemap references.
Updated
Nov 20, 2026
Python
Canonical tag and URL consolidation validator for Canadian digital platforms. Audits canonical consistency and W3C standards.
Updated
Nov 20, 2026
Python
Validador e auditor de tag canonical e consolidacao de URLs. Inspeciona integridade de rotas canonicas, protocolo HTTPS e consistencia W3C.
Updated
Nov 20, 2026
Python
Validador e auditor de robots.txt e diretivas de rastreamento. Inspecao de User-agent, bloqueios acidentais e declaracao de sitemaps.
Updated
Nov 20, 2026
Python
Validador y auditor de robots.txt y directivas de rastreo. Inspeccion de User-agent, bloqueos accidentales y declaracion de sitemaps.
Updated
Nov 20, 2026
Python
Robots.txt validator for Australian web systems. Verifies User-agent permissions, crawl boundaries, and sitemap linkages.
Updated
Nov 20, 2026
Python
Robots.txt validator for New Zealand digital channels. Audits crawler directives, exclusion rules, and sitemap entries.
Updated
Nov 20, 2026
Python
Validateur et auditeur de robots.txt et directives d'exploration. Controle de User-agent, blocages accidentels et sitemaps.
Updated
Nov 20, 2026
Python
Canonical tag and URL consolidation validator. Audits canonical consistency, HTTPS protocol alignment, and W3C standards.
Updated
Nov 20, 2026
Python
Validateur de balise canonique et de consolidation d'URL. Audite l'integrite des URLs canoniques, le protocole HTTPS et les normes W3C.
Updated
Nov 20, 2026
Python
Robots.txt and crawler directives validator. Audits User-agent rules, accidental disallow traps, and sitemap declarations.
Updated
Nov 20, 2026
Python
Validatore di tag canonico e consolidamento URL. Verifica integrita degli URL canonici, protocollo HTTPS e standard W3C.
Updated
Nov 20, 2026
Python
Add this topic to your repo
To associate your repository with the
crawlability
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.