zara.com robots.txt

Zara.com has robots.txt file. Http response code is 200.
Robots size is small. It is about 165 kb and 65 rows.

zara.com has sitemap file https://www.zara.com/sitemaps/sitemap-index.xml.gz. Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain zara.com in robots.txt file. 
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /xa/
                    [1] => /xt/
                    [2] => /xf/
                    [3] => /xp/
                    [4] => /xh/
                    [5] => /xx/
                    [6] => /xc/
                    [7] => /xu/
                    [8] => /xb/
                    [9] => /xl/
                    [10] => /xm/
                    [11] => /xy/
                    [12] => /xs/
                    [13] => /xw/
                    [14] => /xg/
                    [15] => /c4/
                    [16] => /users/
                    [17] => /*/user
                    [18] => /*/shop/
                    [19] => /*/search
                    [20] => /mkt/
                    [21] => /*/size-guide
                    [22] => /*/guest-user/
                    [23] => /*/mini-shop-cart
                    [24] => /share/
                    [25] => /*/*/share/*pid=*
                    [26] => /recom/
                    [27] => /*/*/gift-ticket*
                    [28] => /*/*/help-center/GiftCard
                    [29] => *?amp
                    [30] => *?catalogId=
                    [31] => *?color=
                    [32] => *?colorId=
                    [33] => *?donationOnly=
                    [34] => *?fts=
                    [35] => *?lookDetail=
                    [36] => *?ref=
                    [37] => *?rows=
                    [38] => *?pageu
                    [39] => *&initialBlockId=*
                    [40] => /*/-pM
                    [41] => /?*
                    [42] => */integration/chat-static/
                    [43] => *integration/mectitofa/
                    [44] => */placement/*
                    [45] => */util/messages
                    [46] => /_sec/
                    [47] => /stdstatic-recoms/
                    [48] => /botfende*
                    [49] => /assets/public/
                    [50] => */akam/*
                    [51] => */8y46UXJ4p/*
                    [52] => */B5p-uMw5yh/*
                    [53] => */8-Tx/*
                    [54] => */QAbIDZliR0d9FROWzQ/*
                    [55] => */nNdvzg/*
                )

            [sitemap] => Array
                (
                    [0] => https://www.zara.com/sitemaps/sitemap-index.xml.gz
                )

        )

)

User-agent: *
Disallow: /xa/
Disallow: /xt/
Disallow: /xf/
Disallow: /xa/
Disallow: /xp/
Disallow: /xh/
Disallow: /xx/
Disallow: /xc/
Disallow: /xu/
Disallow: /xb/
Disallow: /xl/
Disallow: /xm/
Disallow: /xy/
Disallow: /xs/
Disallow: /xw/
Disallow: /xg/
Disallow: /c4/
Disallow: /users/
Disallow: /*/user
Disallow: /*/shop/
Disallow: /*/search
Disallow: /mkt/
Disallow: /*/size-guide
Disallow: /*/guest-user/
Disallow: /*/mini-shop-cart
Disallow: /share/
Disallow: /*/*/share/*pid=*
Disallow: /recom/
Disallow: /*/*/gift-ticket*
Disallow: /*/*/help-center/GiftCard
Disallow: *?amp
Disallow: *?catalogId=
Disallow: *?color=
Disallow: *?colorId=
Disallow: *?donationOnly=
Disallow: *?fts=
Disallow: *?lookDetail=
Disallow: *?ref=
Disallow: *?rows=
Disallow: *?pageu
Disallow: *&initialBlockId=*
Disallow: /*/-pM
Disallow: /?*
Disallow: */integration/chat-static/
Disallow: *integration/mectitofa/
Disallow: */placement/*
Disallow: */util/messages
Disallow: /_sec/
Disallow: /stdstatic-recoms/
Disallow: /botfende*
Disallow: /assets/public/



#bitdefender

Disallow: */akam/*
Disallow: */8y46UXJ4p/*
Disallow: */B5p-uMw5yh/*
Disallow: */8-Tx/*
Disallow: */QAbIDZliR0d9FROWzQ/*
Disallow: */nNdvzg/*

Sitemap: https://www.zara.com/sitemaps/sitemap-index.xml.gz
  • код 301 http://zara.com/robots.txt
  • код 200 https://www.zara.com/robots.txt