Robots.txt

Robots.txt Rules

Crawler Rules
twitterbot
  • Allow: /
  • Disallow:
facebookexternalhit
  • Allow: /
  • Allow: /s/
  • Allow: /sh/
  • Allow: /scl/
  • Allow: /sc/
All
  • Allow: /
  • Allow: /static/css/
  • Allow: /static/images/
  • Allow: /static/js/
  • Allow: /llms.txt
  • Disallow: /static/
  • Disallow: /password_expired
  • Disallow: /help/sl
  • Disallow: /help/vodafone
  • Disallow: /home
  • Disallow: /package_files_uploaded_via_chrome
  • Disallow: /photos/app_store_link/
  • Disallow: /recover
  • Disallow: /sharing/
  • Disallow: /sharing/folders
  • Disallow: /sharing/files
  • Disallow: /requests
  • Disallow: /account
  • Disallow: /referrals
  • Disallow: /downgrade
  • Disallow: /developers-v1
  • Disallow: /developers/downloads/sdks/
  • Disallow: /developers/whats_new
  • Disallow: /preview/
  • Disallow: /s/
  • Disallow: /sh/
  • Disallow: /scl/
  • Disallow: /sc/

Sitemaps

Priority Location
1https://www.dropbox.com/sitemapindex.xml

Raw Text

User-agent: Twitterbot
Disallow:

User-agent: facebookexternalhit
Allow: /s/
Allow: /sh/
Allow: /scl/
Allow: /sc/

User-agent: *
Allow: /static/css/
Allow: /static/images/
Allow: /static/js/
Allow: /llms.txt
Disallow: /static/
Disallow: /password_expired
Disallow: /help/sl
Disallow: /help/vodafone
Disallow: /home*
Disallow: /package_files_uploaded_via_chrome
Disallow: /photos/app_store_link/
Disallow: /recover*
Disallow: /sharing/*
Disallow: /sharing/folders*
Disallow: /sharing/files*
Disallow: /requests*
Disallow: /account*
Disallow: /referrals*
Disallow: /downgrade*
Disallow: /developers-v1
Disallow: /developers/downloads/sdks/
Disallow: /developers/whats_new
Disallow: /preview/
Disallow: /s/
Disallow: /sh/
Disallow: /scl/
Disallow: /sc/


Sitemap: https://www.dropbox.com/sitemapindex.xml