Shopomio.ru has robots.txt file. Http response status is 200.
Robots size is small. It is about 138 kb and 50 rows.

shopomio.ru has sitemap file https://static.shopomio.ru/sitemap/sitemap.xml. Main host for shopomio.ru is https://shopomio.ru.

Array
(
    [*] => Array
        (
            [allow] => Array
                (
                    [0] => /*.js
                    [1] => /*.css
                    [2] => /*.jpg
                    [3] => /*.png
                )

            [disallow] => Array
                (
                    [0] => *&*
                    [1] => *?q=*
                    [2] => *?categoryId*
                    [3] => *?shopId*
                    [4] => *?brandId*
                    [5] => *?tagId*
                    [6] => *?subid*
                    [7] => *?subid4*
                    [8] => *?limit*
                    [9] => *?sortField*
                    [10] => *?priceFrom*
                    [11] => *?priceTo*
                    [12] => *?attr*
                    [13] => /search*
                    [14] => /p/count_views*
                    [15] => *?tag=*
                    [16] => *?p*
                    [17] => /login*
                )

            [sitemap] => Array
                (
                    [0] => https://static.shopomio.ru/sitemap/sitemap.xml
                )

            [host] => https://shopomio.ru
        )

    [yandex] => Array
        (
            [allow] => Array
                (
                    [0] => /*.js
                    [1] => /*.css
                    [2] => /*.jpg
                    [3] => /*.png
                )

            [disallow] => Array
                (
                    [0] => *&*
                    [1] => *?q=*
                    [2] => *?categoryId*
                    [3] => *?shopId*
                    [4] => *?brandId*
                    [5] => *?tagId*
                    [6] => *?subid*
                    [7] => *?subid4*
                    [8] => *?limit*
                    [9] => *?sortField*
                    [10] => *?priceFrom*
                    [11] => *?priceTo*
                    [12] => *?attr*
                    [13] => /search*
                    [14] => /menu-load*
                    [15] => /p/count_views*
                    [16] => *?tag=*
                    [17] => *?p*
                    [18] => /login*
                )

            [clean-param] => Array
                (
                    [0] => q&sortField&subid4&subid&limit&priceFrom&priceTo&categoryId&attr&keyword&subid1&brandId&isSale&sortDirection&shopId&_destination&subid2
                )

        )

)
User-agent: *
Allow: /*.js
Allow: /*.css
Allow: /*.jpg
Allow: /*.png
Disallow: *&*
Disallow: *?q=*
Disallow: *?categoryId*
Disallow: *?shopId*
Disallow: *?brandId*
Disallow: *?tagId*
Disallow: *?subid*
Disallow: *?subid4*
Disallow: *?limit*
Disallow: *?sortField*
Disallow: *?priceFrom*
Disallow: *?priceTo*
Disallow: *?attr*
Disallow: /search*
Disallow: /p/count_views*
Disallow: *?tag=*
Disallow: *?p*
Disallow: /login*

Sitemap: https://static.shopomio.ru/sitemap/sitemap.xml

User-agent: Yandex
Allow: /*.js
Allow: /*.css
Allow: /*.jpg
Allow: /*.png
Disallow: *&*
Disallow: *?q=*
Disallow: *?categoryId*
Disallow: *?shopId*
Disallow: *?brandId*
Disallow: *?tagId*
Disallow: *?subid*
Disallow: *?subid4*
Disallow: *?limit*
Disallow: *?sortField*
Disallow: *?priceFrom*
Disallow: *?priceTo*
Disallow: *?attr*
Disallow: /search*
Disallow: /menu-load*
Disallow: /p/count_views*
Disallow: *?tag=*
Disallow: *?p*
Disallow: /login*
Host: https://shopomio.ru
Clean-param: q&sortField&subid4&subid&limit&priceFrom&priceTo&categoryId&attr&keyword&subid1&brandId&isSale&sortDirection&shopId&_destination&subid2
  • код 301 http://shopomio.ru/robots.txt
  • код 200 https://shopomio.ru/robots.txt