Thegrid.org.uk has robots.txt file. Http response code is 200.
Robots size is very small. It is about 3 kb and 2 rows.

Robots.txt contains very strange content because there only allow rules and no disallow.

Host directive is not presented for domain thegrid.org.uk in robots.txt file.
Array
(
    [*] => Array
        (
            [allow] => Array
                (
                    [0] => /
                )

        )

)
User-agent: *
Allow: /
  • код 301 http://thegrid.org.uk/robots.txt
  • код 200 https://thegrid.org.uk/robots.txt