Madelon17.waarbenjij.nu has robots.txt file. Http response status is 200.
Robots size is very small. It is about 24 kb and 8 rows.

madelon17.waarbenjij.nu has sitemap file https://waarbenjij.nu/sitemap/sitemap.xml. Host directive is not presented for domain madelon17.waarbenjij.nu in robots.txt file.
Array
(
    [*] => Array
        (
            [allow] => Array
                (
                    [0] => /ads.txt
                )

            [disallow] => Array
                (
                    [0] => /ads
                    [1] => /fotoboek/
                )

            [sitemap] => Array
                (
                    [0] => https://waarbenjij.nu/sitemap/sitemap.xml
                )

        )

    [yandex] => Array
        (
            [disallow] => Array
                (
                    [0] => /
                )

        )

)
User-agent: *
Allow: /ads.txt
Disallow: /ads

User-agent: Yandex
Disallow: / # blocks access to whole site

User-agent: *
Disallow: /fotoboek/

Sitemap: https://waarbenjij.nu/sitemap/sitemap.xml
  • код 302 http://madelon17.waarbenjij.nu/robots.txt
  • код 200 https://madelon17.waarbenjij.nu/robots.txt