Robots.txt

Robots.txt Rules

Crawler Rules
All
  • Allow: /
  • Allow: /*.js
  • Allow: /*.css
  • Allow: /*?page
  • Allow: /*?ref=
  • Allow: /?telefon=
  • Allow: /?email=
  • Allow: /?nickname=
  • Allow: /search/?q=
  • Allow: /gb/?domen=
  • Allow: /gb/?ip=
  • Allow: /tests/?ogrn=
  • Allow: /tests/?inn=
  • Allow: /tests/?vin=
  • Allow: /search/

Sitemaps

Priority Location
2https://osint.moy.su/sitemap.xml
1https://osint.moy.su/sitemap-site.xml

Raw Text

User-agent: *
Allow: /*.js
Allow: /*.css
Allow: /*?page
Allow: /*?ref=
Allow: /?telefon=
Allow: /?email=
Allow: /?nickname=
Allow: /search/?q=
Allow: /gb/?domen=
Allow: /gb/?ip=
Allow: /tests/?ogrn=
Allow: /tests/?inn=
Allow: /tests/?vin=
Allow: /search/

Sitemap: https://osint.moy.su/sitemap.xml
Sitemap: https://osint.moy.su/sitemap-site.xml