User-Agent Crawl-delay 10 Disallow index php Disallow bitrix Disallow

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
User-Agent: *
Crawl-delay: 10
Disallow: /*index.php
Disallow: /*bitrix
Disallow: /*show_
Disallow: /*clear_cache
Disallow: /*ADD_TO_COMPARE_LIST
Disallow: /*ORDER_BY
Disallow: /*PAGEN
Disallow: /*print
Disallow: /*action
Disallow: /*register=
Disallow: /*password=
Disallow: /*login=
Disallow: /*logout=
Disallow: /*auth=
Disallow: /*backurl=
Disallow: /*back_url=
Disallow: /*BACKURL=
Disallow: /*BACK_URL=
Disallow: /*back_url_admin=
Disallow: /*utm_source=
Disallow: /api/
Disallow: /cron/
Disallow: /include/
Disallow: /test/
Disallow: /old_sitemap/
Disallow: /home
Disallow: /ru/
Disallow: /*order*
Sitemap: https://metropol-moscow.ru/sitemap.xml