Robots.txt

Robots.txt Rules

Crawler Rules
All
  • Allow: /
  • Disallow: /WebObjects/
  • Disallow: /api/
  • Disallow: /includes/
  • Disallow: /v1/
  • Disallow: */search?

Sitemaps

Priority Location
6https://apps.apple.com/sitemaps_apps_index_chart_1.xml
5https://apps.apple.com/sitemaps_apps_index_app_1.xml
4https://apps.apple.com/sitemaps_apps_index_new-app_1.xml
3https://apps.apple.com/sitemaps_apps_index_story_1.xml
2https://apps.apple.com/sitemaps_apps_index_grouping_1.xml
1https://apps.apple.com/sitemaps_apps_index_static-url_1.xml

Raw Text

User-agent: *
Disallow: /WebObjects/*
Disallow: /api/*
Disallow: /includes/*
Disallow: /v1/*
Disallow: */search?*

Sitemap: https://apps.apple.com/sitemaps_apps_index_chart_1.xml
Sitemap: https://apps.apple.com/sitemaps_apps_index_app_1.xml
Sitemap: https://apps.apple.com/sitemaps_apps_index_new-app_1.xml
Sitemap: https://apps.apple.com/sitemaps_apps_index_story_1.xml
Sitemap: https://apps.apple.com/sitemaps_apps_index_grouping_1.xml
Sitemap: https://apps.apple.com/sitemaps_apps_index_static-url_1.xml