8500.ru has robots.txt file. Http response status is 200.
Robots size is very small. It is about 35 kb and 13 rows.

8500.ru has sitemap file https://8500.ru/sitemap.xml. Main host for 8500.ru is https://8500.ru.

Array
(
    [mj12bot] => Array
        (
            [disallow] => Array
                (
                    [0] => /
                )

        )

    [*] => Array
        (
            [allow] => Array
                (
                    [0] => /qrcode/$
                )

            [disallow] => Array
                (
                    [0] => /up/
                    [1] => /add_url/
                    [2] => /action.html
                    [3] => /scan-user-agent.html
                    [4] => /sbrfonline/
                    [5] => /cat/*.jpg
                    [6] => /qrcode/
                )

            [host] => https://8500.ru
            [sitemap] => Array
                (
                    [0] => https://8500.ru/sitemap.xml
                )

        )

)
User-agent: MJ12bot
Disallow: /

User-agent: *
Allow: /qrcode/$
Disallow: /up/
Disallow: /add_url/
Disallow: /action.html
Disallow: /scan-user-agent.html
Disallow: /sbrfonline/
Disallow: /cat/*.jpg
Disallow: /qrcode/
Host: https://8500.ru
Sitemap: https://8500.ru/sitemap.xml
  • код 200 http://8500.ru/robots.txt