taobao.com robots.txt

Taobao.com has robots.txt file. Http response code is 200.
Robots size is very small. It is about 8 kb and 4 rows.

Host directive is not presented for domain taobao.com in robots.txt file. 
Array
(
    [*] => Array
        (
            [allow] => Array
                (
                    [0] => /list/*
                    [1] => /list/*?*
                )

            [disallow] => Array
                (
                    [0] => /*?*
                )

        )

)

User-agent: *
Allow: /list/*
Allow: /list/*?*
Disallow: /*?*
  • код 301 http://taobao.com/robots.txt
  • код 302 https://taobao.com/robots.txt
  • код 200 https://www.taobao.com/robots.txt