Hurriyet.com.tr has robots.txt file. Http response code is 200.
Robots size is small. It is about 73 kb and 25 rows.

Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain hurriyet.com.tr in robots.txt file.
Array
(
    [*] => Array
        (
            [sitemap] => Array
                (
                    [0] => https://www.hurriyet.com.tr/sitemaps/newssitemap.xml
                    [1] => https://www.hurriyet.com.tr/sitemaps/posts.xml
                )

            [disallow] => Array
                (
                    [0] => /ad/
                    [1] => /api/
                    [2] => /arkadasimamektup/
                    [3] => /haberler/ozet/
                    [4] => /okurtemsilcisi/
                    [5] => /yerelsecim2009/
                    [6] => /widgets/
                    [7] => /_includes/
                    [8] => /_othernews/
                    [9] => /_test/
                    [10] => /_includescms/
                    [11] => /arama/
                )

        )

    [flipboard] => Array
        (
        )

    [flipboardproxy] => Array
        (
            [allow] => Array
                (
                    [0] => /api/
                )

        )

    [yandexnews] => Array
        (
            [allow] => Array
                (
                    [0] => //winapp.hurriyet.com.tr/yandexnews.aspx
                )

        )

    [proximic] => Array
        (
        )

)
User-agent:*
Sitemap: https://www.hurriyet.com.tr/sitemaps/newssitemap.xml
Sitemap: https://www.hurriyet.com.tr/sitemaps/posts.xml
Disallow: /ad/
Disallow: /api/
Disallow: /arkadasimamektup/
Disallow: /haberler/ozet/
Disallow: /okurtemsilcisi/
Disallow: /yerelsecim2009/
Disallow: /widgets/
Disallow: /_includes/
Disallow: /_othernews/
Disallow: /_test/
Disallow: /_includescms/
Disallow: /arama/

User-agent: Flipboard
User-agent: FlipboardProxy
Allow: /api/

User-agent: YandexNews
Allow://winapp.hurriyet.com.tr/yandexnews.aspx

User-agent: proximic
Disallow:
  • код 301 http://hurriyet.com.tr/robots.txt
  • код 200 https://www.hurriyet.com.tr/robots.txt