Jobdnes.cz has robots.txt file. Http response status is 200.
Robots size is very small. It is about 11 kb and 5 rows.

Host directive is not presented for domain jobdnes.cz in robots.txt file.
Array
(
    [*] => Array
        (
            [allow] => Array
                (
                    [0] => /
                )

            [disallow] => Array
                (
                    [0] => /job/reaction/*
                )

        )

    [gptbot] => Array
        (
            [crawl-delay] => 10
        )

)
User-agent: *
Allow: /
Disallow: /job/reaction/*

User-agent: GPTBot
Crawl-delay: 10
  • код 301 http://jobdnes.cz/robots.txt
  • код 301 https://jobdnes.cz/robots.txt
  • код 200 https://www.jobdnes.cz/robots.txt