Bestestofzuigers.nl has robots.txt file. Http response code is 200.
Robots size is very small. It is about 23 kb and 8 rows.

bestestofzuigers.nl has sitemap file https://www.bestestofzuigers.nl/sitemap_index.xml. Host directive is not presented for domain bestestofzuigers.nl in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /wp-admin/
                    [1] => /go/*
                    [2] => /search
                    [3] => /*?s=
                )

            [allow] => Array
                (
                    [0] => /wp-admin/admin-ajax.php
                )

            [sitemap] => Array
                (
                    [0] => https://www.bestestofzuigers.nl/sitemap_index.xml
                )

        )

)
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /go/*
Disallow: /search
Disallow: /*?s=

Sitemap: https://www.bestestofzuigers.nl/sitemap_index.xml
  • код 301 http://bestestofzuigers.nl/robots.txt
  • код 200 https://bestestofzuigers.nl/robots.txt