Newpost.gr has robots.txt file. Http response code is 200.
Robots size is very small. It is about 16 kb and 4 rows.

Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain newpost.gr in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /npost-login
                )

            [sitemap] => Array
                (
                    [0] => https://newpost.gr/sitemap_index.xml
                    [1] => https://newpost.gr/news-sitemap.xml
                )

        )

)
User-Agent: *
Disallow:/npost-login

Sitemap: https://newpost.gr/sitemap_index.xml
Sitemap: https://newpost.gr/news-sitemap.xml
  • код 301 http://newpost.gr/robots.txt
  • код 200 https://newpost.gr/robots.txt