Zalando.es has robots.txt file. Http response status is 200.
Robots size is very small. It is about 44 kb and 16 rows.

Host directive is not presented for domain zalando.es in robots.txt file.
Array
(
    [pinterestbot] => Array
        (
            [crawl-delay] => 0.2
        )

    [*] => Array
        (
            [allow] => Array
                (
                    [0] => /trend-rewind/*
                    [1] => /api/navigation
                    [2] => /api/graphql/
                )

            [disallow] => Array
                (
                    [0] => /*&*&*&*
                    [1] => /cart/*
                    [2] => /wardrobe/*
                    [3] => /myaccount/*
                    [4] => /opinions*
                    [5] => /api/navigation/*
                    [6] => /api/*
                    [7] => /consent/api/ucversion
                    [8] => /reco-catalog/
                    [9] => /assistant
                )

        )

)
User-agent: Pinterestbot
Crawl-delay: 0.2

User-agent: *
Allow: /trend-rewind/*
Disallow: /*&*&*&*
Disallow: /cart/*
Disallow: /wardrobe/*
Disallow: /myaccount/*
Disallow: /opinions*
Allow: /api/navigation
Allow: /api/graphql/
Disallow: /api/navigation/*
Disallow: /api/*
Disallow: /consent/api/ucversion
Disallow: /reco-catalog/
Disallow: /assistant
  • код 301 http://zalando.es/robots.txt
  • код 302 https://zalando.es/robots.txt
  • код 200 https://www.zalando.es/robots.txt