Gyao.yahoo.co.jp has robots.txt file. Http response code is 200.
Robots size is very small. It is about 51 kb and 11 rows.

gyao.yahoo.co.jp has great amount of sitemap files — 3: https://gyao.yahoo.co.jp/include/generator_files/SiteMap/sitemap_index.xml, https://gyao.yahoo.co.jp/feed/sitemap/standard/sitemap_index.xml, https://gyao.yahoo.co.jp/feed/sitemap/store/sitemap_index.xml. Host directive is not presented for domain gyao.yahoo.co.jp in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /my/
                    [1] => /popreview/
                    [2] => /deletereview/
                    [3] => /reportreview/
                    [4] => /feature/login/app/download
                    [5] => /rss/
                )

            [allow] => Array
                (
                    [0] => /rss/newlypg/all/
                )

            [sitemap] => Array
                (
                    [0] => https://gyao.yahoo.co.jp/include/generator_files/SiteMap/sitemap_index.xml
                    [1] => https://gyao.yahoo.co.jp/feed/sitemap/standard/sitemap_index.xml
                    [2] => https://gyao.yahoo.co.jp/feed/sitemap/store/sitemap_index.xml
                )

        )

)
User-Agent: *
Disallow: /my/
Disallow: /popreview/
Disallow: /deletereview/
Disallow: /reportreview/
Disallow: /feature/login/app/download
Disallow: /rss/
Allow: /rss/newlypg/all/
Sitemap: https://gyao.yahoo.co.jp/include/generator_files/SiteMap/sitemap_index.xml
Sitemap: https://gyao.yahoo.co.jp/feed/sitemap/standard/sitemap_index.xml
Sitemap: https://gyao.yahoo.co.jp/feed/sitemap/store/sitemap_index.xml
  • код 301 http://gyao.yahoo.co.jp/robots.txt
  • код 200 https://gyao.yahoo.co.jp/robots.txt