# Query-string URLs (search filters, numerology ?n=, DNA ?g=&p=, tops ?all=) are an endless # URL space with no content of their own; paginated lists use path segments, not queries. User-agent: * Disallow: /*? Disallow: /admin Disallow: /account Disallow: /lists$ Disallow: /lists/ Disallow: /vote/ Disallow: /login Disallow: /register # Crawlers that honour Crawl-delay (a group replaces "*" for them, so the rules are repeated) User-agent: AhrefsBot User-agent: SemrushBot User-agent: MJ12bot User-agent: DotBot User-agent: PetalBot User-agent: Bytespider User-agent: Amazonbot User-agent: meta-externalagent User-agent: DataForSeoBot User-agent: BLEXBot Crawl-delay: 5 Disallow: /*? Disallow: /admin Disallow: /account Disallow: /lists$ Disallow: /lists/ Disallow: /vote/ Disallow: /login Disallow: /register Sitemap: https://babynames.baby/sitemap.xml