Robots.txt

Robots.txt Rules

Crawler Rules
All
  • Allow: /
  • Allow: /wp-admin/admin-ajax.php
  • Allow: /forums/topic-tag/reader/
  • Allow: /*/forums/topic-tag/reader/
  • Allow: /support/reader/
  • Allow: /*/support/reader/
  • Allow: /log-in/
  • Allow: /log-in$
  • Disallow: /wp-admin/
  • Disallow: /typo/?subdomain=
  • Disallow: /read/
  • Disallow: /*/read/
  • Disallow: /reader/
  • Disallow: /*/reader/
  • Disallow: /log-in?
  • Disallow: /abuse/?
  • Disallow: /abuse?
  • Disallow: /plugins/?s=
  • Disallow: /*/plugins/?s=
  • Disallow: /*?aff=
  • Disallow: /*&aff=
  • Disallow: /*?affiliate=
  • Disallow: /*&affiliate=
  • Disallow: /*?cid=
  • Disallow: /*&cid=
  • Disallow: /*?irclickid=
  • Disallow: /*&irclickid=
  • Disallow: /*/?like_comment=
  • Disallow: /*?retry=
  • Disallow: /*?sid=
  • Disallow: /*?action=
  • Disallow: /wp-login.php
  • Disallow: /wp-signup.php
  • Disallow: /press-this.php
  • Disallow: /remote-login.php
  • Disallow: /activate/
  • Disallow: /cgi-bin/
  • Disallow: /mshots/v1/
  • Disallow: /next/
  • Disallow: /public.api/

Sitemaps

Priority Location
5https://wordpress.com/sitemap.xml
4https://wordpress.com/news-sitemap.xml
3https://wordpress.com/go/sitemap.xml
2https://wordpress.com/blog/sitemap.xml
1https://wordpress.com/support/sitemap.xml

Raw Text

# If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.
# Please see https://developer.wordpress.com/docs/firehose/ for more details.

Sitemap: https://wordpress.com/sitemap.xml
Sitemap: https://wordpress.com/news-sitemap.xml

Sitemap: https://wordpress.com/go/sitemap.xml
Sitemap: https://wordpress.com/blog/sitemap.xml
Sitemap: https://wordpress.com/support/sitemap.xml

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /typo/?subdomain=
Disallow: /read/
Disallow: /*/read/
Allow: /forums/topic-tag/reader/
Allow: /*/forums/topic-tag/reader/
Allow: /support/reader/
Allow: /*/support/reader/
Disallow: /reader/
Disallow: /*/reader/
Allow: /log-in/
Allow: /log-in$
Disallow: /log-in?
Disallow: /abuse/?*
Disallow: /abuse?*
Disallow: /plugins/?s=
Disallow: /*/plugins/?s=
Disallow: /*?aff=
Disallow: /*&aff=
Disallow: /*?affiliate=
Disallow: /*&affiliate=
Disallow: /*?cid=
Disallow: /*&cid=
Disallow: /*?irclickid=
Disallow: /*&irclickid=
Disallow: /*/?like_comment=
Disallow: /*?retry=
Disallow: /*?sid=
Disallow: /*?action=
Disallow: /wp-login.php
Disallow: /wp-signup.php
Disallow: /press-this.php
Disallow: /remote-login.php
Disallow: /activate/
Disallow: /cgi-bin/
Disallow: /mshots/v1/
Disallow: /next/
Disallow: /public.api/

# This file was generated on Thu, 06 Aug 2026 17:07:01 +0000