Robots.txt
Submit
Robots.txt Rules
Crawler
Rules
All
Allow
: /
Disallow
: /rest/
Sitemaps
Priority
Location
1
https://www.4shared.com/web/sitemap.xml
Raw Text
User-agent: * Disallow: /rest/ Sitemap: https://www.4shared.com/web/sitemap.xml