jobdnes.cz robots.txt
Jobdnes.cz has robots.txt file. Http response status is 200.
Robots size is very small. It is about 11 kb and 5 rows.
Host directive is not presented for domain jobdnes.cz in robots.txt file.
Robots size is very small. It is about 11 kb and 5 rows.
Host directive is not presented for domain jobdnes.cz in robots.txt file.
Array
(
[*] => Array
(
[allow] => Array
(
[0] => /
)
[disallow] => Array
(
[0] => /job/reaction/*
)
)
[gptbot] => Array
(
[crawl-delay] => 10
)
)
User-agent: * Allow: / Disallow: /job/reaction/* User-agent: GPTBot Crawl-delay: 10
- код 301 http://jobdnes.cz/robots.txt
- код 301 https://jobdnes.cz/robots.txt
- код 200 https://www.jobdnes.cz/robots.txt