Alligator.spb.ru has robots.txt file. Http response status is 200.
Robots size is very small. It is about 47 kb and 15 rows.

Robots.txt for User-Agent=* contains only disallow directives.

Main host for alligator.spb.ru is https://www.alligator.spb.ru.

Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /bitrix/
                    [1] => /admin/
                    [2] => /upload/
                    [3] => /img/
                    [4] => /forum/user/*
                    [5] => /forum/users/*
                    [6] => *PAGE_NAME=search*
                    [7] => *profile_view*
                    [8] => *user_list*
                    [9] => *user_post*
                    [10] => /catalog/programma-elastichnykh-pokrytiy/polymer-flex/
                )

            [host] => https://www.alligator.spb.ru
        )

    [googlebot] => Array
        (
            [disallow] => Array
                (
                    [0] => /statss5.php
                )

        )

)
User-agent: *
Disallow: /bitrix/
Disallow: /admin/
Disallow: /upload/
Disallow: /img/
Disallow: /forum/user/*
Disallow: /forum/users/*
Disallow: *PAGE_NAME=search*
Disallow: *profile_view*
Disallow: *user_list*
Disallow: *user_post*
Disallow: /catalog/programma-elastichnykh-pokrytiy/polymer-flex/
host: https://www.alligator.spb.ru

User-agent: Googlebot
Disallow: /statss5.php
  • код 200 http://alligator.spb.ru/robots.txt