kinoprice.ru robots.txt
Kinoprice.ru has robots.txt file. Http response code is 200.
Robots size is small. It is about 75 kb and 33 rows.
The Domain is inaccessible for indexation by search robots because robots.txt has directive "Disallow: /".
Host directive is not presented for domain kinoprice.ru in robots.txt file.kinoprice.ru has separate rules for googlebot and yandexbot and also has rules for all bots (User-Agent=*).
Robots size is small. It is about 75 kb and 33 rows.
The Domain is inaccessible for indexation by search robots because robots.txt has directive "Disallow: /".
Host directive is not presented for domain kinoprice.ru in robots.txt file.kinoprice.ru has separate rules for googlebot and yandexbot and also has rules for all bots (User-Agent=*).
Array
(
[googlebot] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[baiduspider] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[yandexbot] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[ichiro] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[sogou spider] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[sosospider] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[youdaobot] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[yetibot] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[bingbot] => Array
(
[crawl-delay] => 2
[disallow] => Array
(
[0] => /?*
)
)
[yahoo! slurp] => Array
(
[crawl-delay] => 2
[disallow] => Array
(
[0] => /?*
)
)
[rdfbot] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[seznambot] => Array
(
[disallow] => Array
(
[0] => /?*
)
)
[ia_archiver] => Array
(
)
[mediapartners-google] => Array
(
)
[*] => Array
(
[disallow] => Array
(
[0] => /
)
)
)
User-agent: Googlebot Disallow: /?* User-agent: Baiduspider Disallow: /?* User-agent: YandexBot Disallow: /?* User-agent: ichiro Disallow: /?* User-agent: sogou spider Disallow: /?* User-agent: Sosospider Disallow: /?* User-agent: YoudaoBot Disallow: /?* User-agent: YetiBot Disallow: /?* User-agent: bingbot Crawl-delay: 2 Disallow: /?* User-Agent: Yahoo! Slurp Crawl-delay: 2 Disallow: /?* User-agent: rdfbot Disallow: /?* User-agent: Seznambot Request-rate: 1/2s Disallow: /?* User-agent: ia_archiver Disallow: User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /
- код 200 http://kinoprice.ru/robots.txt