Gyao.yahoo.co.jp has robots.txt file. Http response code is 200.
Robots size is very small. It is about 35 kb and 5 rows.

gyao.yahoo.co.jp has great amount of sitemap files — 3: https://gyao.yahoo.co.jp/apis/publication/standard/tvod/sitemap_index.xml, https://gyao.yahoo.co.jp/apis/publication/standard/avod/sitemap_index.xml, https://gyao.yahoo.co.jp/apis/publication/standard/special/sitemap_index.xml. Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain gyao.yahoo.co.jp in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /my/
                )

            [sitemap] => Array
                (
                    [0] => https://gyao.yahoo.co.jp/apis/publication/standard/tvod/sitemap_index.xml
                    [1] => https://gyao.yahoo.co.jp/apis/publication/standard/avod/sitemap_index.xml
                    [2] => https://gyao.yahoo.co.jp/apis/publication/standard/special/sitemap_index.xml
                )

        )

)
User-Agent: *
Disallow: /my/
Sitemap: https://gyao.yahoo.co.jp/apis/publication/standard/tvod/sitemap_index.xml
Sitemap: https://gyao.yahoo.co.jp/apis/publication/standard/avod/sitemap_index.xml
Sitemap: https://gyao.yahoo.co.jp/apis/publication/standard/special/sitemap_index.xml
  • код 301 http://gyao.yahoo.co.jp/robots.txt
  • код 200 https://gyao.yahoo.co.jp/robots.txt