Wogibtswas.de has robots.txt file. Http response code is 200.
Robots size is very small. It is about 47 kb and 15 rows.

Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain wogibtswas.de in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /tools/
                    [1] => /stadt/0*
                    [2] => /stadt/1*
                    [3] => /stadt/2*
                    [4] => /stadt/3*
                    [5] => /stadt/4*
                    [6] => /stadt/5*
                    [7] => /stadt/6*
                    [8] => /stadt/7*
                    [9] => /stadt/8*
                    [10] => /stadt/9*
                )

            [sitemap] => Array
                (
                    [0] => https://wogibtswas.de/sitemaps/sitemapIndex.xml
                    [1] => https://wogibtswas.de/sitemaps/sitemapIndexP.xml
                )

        )

)
# URL:https://wogibtswas.de

User-agent: *
Disallow: /tools/

Disallow: /stadt/0*
Disallow: /stadt/1*
Disallow: /stadt/2*
Disallow: /stadt/3*
Disallow: /stadt/4*
Disallow: /stadt/5*
Disallow: /stadt/6*
Disallow: /stadt/7*
Disallow: /stadt/8*
Disallow: /stadt/9*


Sitemap: https://wogibtswas.de/sitemaps/sitemapIndex.xml
Sitemap: https://wogibtswas.de/sitemaps/sitemapIndexP.xml
  • код 301 http://wogibtswas.de/robots.txt
  • код 200 https://wogibtswas.de/robots.txt