twitch.tv robots.txt

Twitch.tv has robots.txt file. Http response code is 200.
Robots size is very small. It is about 40 kb and 14 rows.

twitch.tv has sitemap file https://www.twitch.tv/sitemapv2_index.xml.gz. Host directive is not presented for domain twitch.tv in robots.txt file. 
Array
(
    [*] => Array
        (
            [allow] => Array
                (
                    [0] => /
                    [1] => /directory
                    [2] => /directory/all
                    [3] => /directory/*
                    [4] => /videos/week
                    [5] => /.well-known/assetlinks.json
                )

            [disallow] => Array
                (
                    [0] => /admin/*
                    [1] => /email-unsubscribe/
                    [2] => /login$
                    [3] => /message/*
                    [4] => /signup$
                    [5] => /user/*
                )

            [sitemap] => Array
                (
                    [0] => https://www.twitch.tv/sitemapv2_index.xml.gz
                )

        )

)

User-Agent: *
Allow: /
Allow: /directory
Allow: /directory/all
Allow: /directory/*
Allow: /videos/week
Allow: /.well-known/assetlinks.json
Disallow: /admin/*
Disallow: /email-unsubscribe/
Disallow: /login$
Disallow: /message/*
Disallow: /signup$
Disallow: /user/*

Sitemap: https://www.twitch.tv/sitemapv2_index.xml.gz
  • код 301 http://twitch.tv/robots.txt
  • код 301 https://twitch.tv/robots.txt
  • код 200 https://www.twitch.tv/robots.txt