Robots.txt

Robots.txt Rules

Crawler Rules
Baidu
  • Allow: /
  • Disallow: /
sosospider
  • Allow: /
  • Disallow: /
sogou spider
  • Allow: /
  • Disallow: /
All
  • Allow: /
  • Disallow: /blog/rss
  • Disallow: /blog/rss/
  • Disallow: /blog/rss/

Sitemaps

Priority Location
1https://unity.com/sitemap.xml

Raw Text

User-Agent: Baiduspider
Disallow: /

User-Agent: Sosospider
Disallow: /

User-Agent: sogou spider
Disallow: /

User-Agent: *
Disallow: /blog/rss
Disallow: /blog/rss/
Disallow: /blog/rss/*

Sitemap: https://unity.com/sitemap.xml