Offerio.ru has robots.txt file. Http response status is 200.
Robots size is small. It is about 79 kb and 29 rows.

offerio.ru has sitemap file https://offerio.ru/sitemap.xml. Robots.txt for User-Agent=* contains only disallow directives.

Main host for offerio.ru is https://offerio.ru.

Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /temp/
                    [1] => /rules
                    [2] => /privacy-policy
                    [3] => /politika-cookie
                    [4] => /polzovatelskoe-soglashenie
                    [5] => /prohibited
                    [6] => /map*
                    [7] => /cp*
                    [8] => /ad/update/*
                )

            [host] => https://offerio.ru
            [sitemap] => Array
                (
                    [0] => https://offerio.ru/sitemap.xml
                )

        )

    [yandex] => Array
        (
            [disallow] => Array
                (
                    [0] => /map*
                    [1] => /temp/
                    [2] => /rules
                    [3] => /privacy-policy
                    [4] => /politika-cookie
                    [5] => /polzovatelskoe-soglashenie
                    [6] => /prohibited
                    [7] => /cp*
                    [8] => /ad/update/*
                    [9] => /auth
                    [10] => /ad/create
                    [11] => /promo/*
                )

            [clean-param] => Array
                (
                    [0] => modal
                    [1] => filter[sort]
                )

        )

)
User-agent: *
Disallow: /temp/
Disallow: /rules
Disallow: /privacy-policy
Disallow: /politika-cookie
Disallow: /polzovatelskoe-soglashenie
Disallow: /prohibited
Disallow: /map*
Disallow: /cp*
Disallow: /ad/update/*

User-agent: Yandex
Disallow: /map*
Disallow: /temp/
Disallow: /rules
Disallow: /privacy-policy
Disallow: /politika-cookie
Disallow: /polzovatelskoe-soglashenie
Disallow: /prohibited
Disallow: /cp*
Disallow: /ad/update/*
Disallow: /auth
Disallow: /ad/create
Disallow: /promo/*
Clean-param: modal
Clean-param: filter[sort]

Host: https://offerio.ru
Sitemap: https://offerio.ru/sitemap.xml
  • код 301 http://offerio.ru/robots.txt
  • код 200 https://offerio.ru/robots.txt