Babyclothes.ho.ua has robots.txt file. Http response code is 200.
Robots size is very small. It is about 13 kb and 6 rows.

Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain babyclothes.ho.ua in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /cgi-bin/
                    [1] => /phpbb
                    [2] => /forum
                    [3] => /phpBB
                    [4] => /phorum
                )

        )

)
User-Agent: *
Disallow: /cgi-bin/
Disallow: /phpbb
Disallow: /forum
Disallow: /phpBB
Disallow: /phorum

  • код 200 http://babyclothes.ho.ua/robots.txt