Robots.txt

Robots.txt Rules

Crawler Rules
All
  • Allow: /
  • Disallow: /*/search
  • Disallow: /*/apis
  • Disallow: /*/api
  • Disallow: /*/bin/search.py
  • Disallow: /bin/search.py
  • Disallow: /bin/search.go
  • Disallow: /*/forum-attachment

Sitemaps

Priority Location
Nothing to show.

Raw Text

User-Agent: *
Disallow: /*/search
Disallow: /*/apis
Disallow: /*/api
Disallow: /*/bin/search.py
Disallow: /bin/search.py
Disallow: /bin/search.go
Disallow: /*/forum-attachment