Sports.walla.co.il has robots.txt file. Http response code is 200.
Robots size is very small. It is about 60 kb and 21 rows.

Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain sports.walla.co.il in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => *&timeStamp=
                    [1] => *@entity
                    [2] => *@opinion
                    [3] => *@placation
                    [4] => *@poll.results
                    [5] => /&tagfly=1
                    [6] => *@search&
                    [7] => *hotOrNot.commit
                    [8] => /43010785/*
                    [9] => */userfeedback/facebook.stream.publish
                    [10] => *mobile=*
                    [11] => *?0*
                    [12] => *?feature
                    [13] => *layout=
                    [14] => /*?mediazone*
                    [15] => /*&mediazone*
                    [16] => *navindex=*
                    [17] => /*?fallback*
                    [18] => /*?fb_comment_id*
                )

        )

)
# robots.txt - 2018-03-13

User-agent: *
Disallow: *&timeStamp=
Disallow: *@entity
Disallow: *@opinion
Disallow: *@placation
Disallow: *@poll.results
Disallow: /&tagfly=1
Disallow: *@search&
Disallow: *hotOrNot.commit
Disallow: /43010785/*
Disallow: */userfeedback/facebook.stream.publish
Disallow: *mobile=*
Disallow: *?0*
Disallow: *?feature
Disallow: *layout=
Disallow: /*?mediazone*
Disallow: /*&mediazone*
Disallow: *navindex=*
Disallow: /*?fallback*
Disallow: /*?fb_comment_id*
  • код 301 http://sports.walla.co.il/robots.txt
  • код 200 https://sports.walla.co.il/robots.txt