interpult-s.ru robots.txt

Interpult-s.ru has robots.txt file. Http response code is 200.
Robots size is small. It is about 73 kb and 20 rows.

Host directive is not presented for domain interpult-s.ru in robots.txt file. 
Array
(
    [*] => Array
        (
            [crawl-delay] => 120
            [disallow] => Array
                (
                    [0] => /wp-admin/
                    [1] => /wp-includes/
                    [2] => /trackback/
                    [3] => /wp-login.php
                    [4] => /wp-register.php
                )

            [allow] => Array
                (
                    [0] => /wp-admin/admin-ajax.php
                    [1] => /wp-includes/js/
                    [2] => /wp-includes/images/
                    [3] => /link-building/
                    [4] => /video/
                    [5] => /stati/
                    [6] => /news/
                    [7] => /wp-admin/edit.php
                    [8] => /User-agent: AhrefsSiteAudit
                    [9] => /User-agent: AhrefsBot
                )

        )

)

# This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/
User-agent: *
Crawl-delay: 120
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-includes/
Allow: /wp-includes/js/
Allow: /wp-includes/images/
Allow: /link-building/
Allow: /video/
Allow: /stati/
Allow: /news/
Allow: /wp-admin/edit.php
Disallow: /trackback/
Disallow: /wp-login.php
Disallow: /wp-register.php
Allow: /User-agent: AhrefsSiteAudit
Allow: /User-agent: AhrefsBot

https://interpult-s.ru/sitemap_index.xml
  • код 301 http://interpult-s.ru/robots.txt
  • код 200 https://interpult-s.ru/robots.txt