Mastu.ru has robots.txt file. Http response code is 200.
Robots size is very small. It is about 37 kb and 15 rows.

Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain mastu.ru in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /admin/
                    [1] => /block/
                    [2] => /close_tm/
                    [3] => /enginer/
                    [4] => /error/
                    [5] => /font/
                    [6] => /includes/
                    [7] => /js/
                    [8] => /languages/
                    [9] => /modules/
                    [10] => /plagin/
                    [11] => /templates/
                    [12] => /pro100/
                    [13] => /stat/
                )

        )

)
User-agent: *
Disallow: /admin/
Disallow: /block/
Disallow: /close_tm/
Disallow: /enginer/
Disallow: /error/
Disallow: /font/
Disallow: /includes/
Disallow: /js/
Disallow: /languages/
Disallow: /modules/
Disallow: /plagin/
Disallow: /templates/
Disallow: /pro100/
Disallow: /stat/
  • код 301 http://mastu.ru/robots.txt
  • код 301 http://www.mastu.ru/robots.txt
  • код 200 https://www.mastu.ru/robots.txt