Shop.mango.com has robots.txt file. Http response code is 200.
Robots size is small. It is about 120 kb and 46 rows.

shop.mango.com has sitemap file https://shop.mango.com/sitemap.xml. Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain shop.mango.com in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /*size=*
                    [1] => /*=size*
                    [2] => /*min=*
                    [3] => /*max=*
                    [4] => /*?temporada=*
                    [5] => /*=*,*
                    [6] => /*sort=asc
                    [7] => /*sort=desc
                    [8] => /*/search*
                    [9] => /*?descuento*
                    [10] => /shopurlhome*
                    [11] => /*/helppopup/*
                    [12] => /*GroupsColors=*
                    [13] => /*=colorGroups*
                    [14] => /*Sizes=*
                    [15] => /*Prices=*
                    [16] => /*priceOrder=*
                    [17] => /*?order=*
                    [18] => /*?range=*
                    [19] => /checkout/
                    [20] => /ws-favorites*
                    [21] => /*fashion-assistant
                    [22] => /es1*
                    [23] => /es-cn*
                    [24] => /es2*
                    [25] => /es-ce*
                    [26] => /es3*
                    [27] => /es-ml*
                    [28] => /cy1*
                    [29] => /cy-02*
                    [30] => /gb1*
                    [31] => /gb-cha*
                )

            [sitemap] => Array
                (
                    [0] => https://shop.mango.com/sitemap.xml
                )

        )

    [pinterest] => Array
        (
        )

    [baiduspider] => Array
        (
            [disallow] => Array
                (
                    [0] => /services/header-bag/getBagItems
                )

        )

    [xenu] => Array
        (
            [disallow] => Array
                (
                    [0] => /
                )

        )

    [download ninja] => Array
        (
            [disallow] => Array
                (
                    [0] => /
                )

        )

)
#FILTERS

User-Agent: *
Disallow: /*size=*
Disallow: /*=size*
Disallow: /*min=*
Disallow: /*max=*
Disallow: /*?temporada=*
Disallow: /*=*,*
Disallow: /*sort=asc
Disallow: /*sort=desc
Disallow: /*/search*
Disallow: /*?descuento*
Disallow: /shopurlhome*
Disallow: /*/helppopup/*
Disallow: /*GroupsColors=*
Disallow: /*=colorGroups*
Disallow: /*Sizes=*
Disallow: /*Prices=*
Disallow: /*priceOrder=*
Disallow: /*?order=*
Disallow: /*?range=*
Disallow: /checkout/
Disallow: /ws-favorites*


#FASHION ASSISTANT
Disallow: /*fashion-assistant

#DUPLICATE LANGUAGE
Disallow: /es1*
Disallow: /es-cn*
Disallow: /es2*
Disallow: /es-ce*
Disallow: /es3*
Disallow: /es-ml*
Disallow: /cy1*
Disallow: /cy-02*
Disallow: /gb1*
Disallow: /gb-cha*

#BOTS CONTROLS
User-agent: Pinterest

User-agent: Baiduspider
Disallow: /services/header-bag/getBagItems

User-agent: Xenu
Disallow: /

User-agent: Download Ninja
Disallow: /

#SITEMAPS
Sitemap: https://shop.mango.com/sitemap.xml
  • код 301 http://shop.mango.com/robots.txt
  • код 200 https://shop.mango.com/robots.txt