Robots.txt

Robots.txt Rules

Crawler Rules
gptbot
  • Allow: /
  • Disallow: /
ccbot
  • Allow: /
  • Disallow: /
sentibot
  • Allow: /
  • Allow: /
  • Disallow: /
  • Disallow: /
google-extended
  • Allow: /
  • Disallow: /
facebookbot
  • Allow: /
  • Disallow: /
omgili
  • Allow: /
  • Disallow: /
omgilibot
  • Allow: /
  • Disallow: /
amazonbot
  • Allow: /
  • Disallow: /
Bing
  • Allow: /
  • Disallow: /
All
  • Allow: /

Sitemaps

Priority Location
Nothing to show.

Raw Text

User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: SentiBot
Disallow: /

User-agent: sentibot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: omgili
Disallow: /

User-agent: omgilibot
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: Bingbot
Disallow: /