Newsru.co.il has robots.txt file. Http response code is 200.
Robots size is very small. It is about 3 kb and 2 rows.

The Domain is inaccessible for indexation by search robots because robots.txt has directive "Disallow: /".

Host directive is not presented for domain newsru.co.il in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /
                )

        )

)
User-agent: *
Disallow: /
  • код 200 http://newsru.co.il/robots.txt