Robots.txt

Robots.txt Rules

Crawler Rules
ai2bot
  • Allow: /
ai2bot-dolma
  • Allow: /
aihitbot
  • Allow: /
amazonbot
  • Allow: /
anthropic-ai
  • Allow: /
applebot-extended
  • Allow: /
bytespider
  • Allow: /
ccbot
  • Allow: /
claudebot
  • Allow: /
cohere-ai
  • Allow: /
cohere-training-data-crawler
  • Allow: /
duckassistbot
  • Allow: /
facebookbot
  • Allow: /
google-extended
  • Allow: /
googleother
  • Allow: /
googleother-image
  • Allow: /
googleother-video
  • Allow: /
gptbot
  • Allow: /
img2dataset
  • Allow: /
meta-externalagent
  • Allow: /
mycentralaiscraperbot
  • Allow: /
omgili
  • Allow: /
omgilibot
  • Allow: /
quora-bot
  • Allow: /
tiktokspider
  • Allow: /
youbot
  • Allow: /
adsbot-google
  • Allow: /
adsbot-google-mobile
  • Allow: /
adsbot-google-mobile-apps
  • Allow: /
All
  • Allow: /
  • Allow: /api/ui-extensions/
  • Allow: /commerce$
  • Allow: /commerce/
  • Allow: /api/taxonomy$
  • Allow: /api/taxonomy/
  • Allow: /api/template-taxonomy-service$
  • Allow: /api/template-taxonomy-service/
  • Allow: /api/billing$
  • Allow: /api/billing/
  • Allow: /templates$
  • Allow: /templates/
  • Allow: /tour$
  • Allow: /tour/
  • Allow: /api/v1/marketplace/designers/?page=
  • Allow: /api/v1/marketplace/designers/*/$
  • Allow: /api/extensions/1.0/extensions
  • Allow: /api/extensions/1.0/extensions/
  • Disallow: /config
  • Disallow: /search
  • Disallow: /account$
  • Disallow: /account/
  • Disallow: /commerce/digital-download/
  • Disallow: /api/
  • Disallow: /static/
  • Disallow: /*?author=
  • Disallow: /*&author=
  • Disallow: /*?tag=
  • Disallow: /*&tag=
  • Disallow: /*?month=
  • Disallow: /*&month=
  • Disallow: /*?view=
  • Disallow: /*&view=
  • Disallow: /*?format=json
  • Disallow: /*&format=json
  • Disallow: /*?format=page-context
  • Disallow: /*&format=page-context
  • Disallow: /*?format=main-content
  • Disallow: /*&format=main-content
  • Disallow: /*?format=json-pretty
  • Disallow: /*&format=json-pretty
  • Disallow: /*?format=ical
  • Disallow: /*&format=ical
  • Disallow: /*?reversePaginate=
  • Disallow: /*&reversePaginate=
  • Disallow: /offers$
  • Disallow: /offers/
  • Disallow: /press-coverage/?offset=
  • Disallow: /beta-flag$
  • Disallow: /beta-flag/
  • Disallow: /typography$
  • Disallow: /typography/
  • Disallow: /archived$
  • Disallow: /archived/
  • Disallow: /noindex$
  • Disallow: /noindex/
  • Disallow: /api/1/performance/records
  • Disallow: /api/1/performance/settings
  • Disallow: /api/census/RecordHit
  • Disallow: /api/census/button-render
  • Disallow: /login

Sitemaps

Priority Location
1https://www.squarespace.com/sitemap.xml

Raw Text

# Squarespace Robots Txt

User-agent: AI2Bot
User-agent: Ai2Bot-Dolma
User-agent: aiHitBot
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCBot
User-agent: ClaudeBot
User-agent: cohere-ai
User-agent: cohere-training-data-crawler
User-agent: DuckAssistBot
User-agent: FacebookBot
User-agent: Google-Extended
User-agent: GoogleOther
User-agent: GoogleOther-Image
User-agent: GoogleOther-Video
User-agent: GPTBot
User-agent: img2dataset
User-agent: Meta-ExternalAgent
User-agent: MyCentralAIScraperBot
User-agent: omgili
User-agent: omgilibot
User-agent: Quora-Bot
User-agent: TikTokSpider
User-agent: YouBot
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
User-agent: AdsBot-Google-Mobile-Apps
User-agent: *
Disallow: /config
Disallow: /search
Disallow: /account$
Disallow: /account/
Disallow: /commerce/digital-download/
Disallow: /api/
Allow: /api/ui-extensions/
Disallow: /static/
Disallow:/*?author=*
Disallow:/*&author=*
Disallow:/*?tag=*
Disallow:/*&tag=*
Disallow:/*?month=*
Disallow:/*&month=*
Disallow:/*?view=*
Disallow:/*&view=*
Disallow:/*?format=json
Disallow:/*&format=json
Disallow:/*?format=page-context
Disallow:/*&format=page-context
Disallow:/*?format=main-content
Disallow:/*&format=main-content
Disallow:/*?format=json-pretty
Disallow:/*&format=json-pretty
Disallow:/*?format=ical
Disallow:/*&format=ical
Disallow:/*?reversePaginate=*
Disallow:/*&reversePaginate=*

# WWW Additions
# WWW Additions

Allow: /commerce$
Allow: /commerce/
Allow: /api/taxonomy$
Allow: /api/taxonomy/
Allow: /api/template-taxonomy-service$
Allow: /api/template-taxonomy-service/
Allow: /api/billing$
Allow: /api/billing/
Allow: /templates$
Allow: /templates/
Allow: /tour$
Allow: /tour/
Allow: /api/v1/marketplace/designers/?page=*
Allow: /api/v1/marketplace/designers/*/$
Allow: /api/extensions/1.0/extensions
Allow: /api/extensions/1.0/extensions/
Disallow: /offers$
Disallow: /offers/*
Disallow: /press-coverage/?offset=*
Disallow: /beta-flag$
Disallow: /beta-flag/
Disallow: /typography$
Disallow: /typography/
Disallow: /archived$
Disallow: /archived/
Disallow: /noindex$
Disallow: /noindex/
Disallow: /api/1/performance/records
Disallow: /api/1/performance/settings
Disallow: /api/census/RecordHit
Disallow: /api/census/button-render
Disallow: /login
Sitemap: https://www.squarespace.com/sitemap.xml