canton.edu robots.txt

Canton.edu has robots.txt file. Http response code is 200.
Robots size is very small. It is about 15 kb and 5 rows.

canton.edu has sitemap file https://www.canton.edu/sitemap.xml. Host directive is not presented for domain canton.edu in robots.txt file. 
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /test/
                )

            [allow] => Array
                (
                    [0] => /
                )

            [sitemap] => Array
                (
                    [0] => https://www.canton.edu/sitemap.xml
                )

        )

)

# robots.txt for www.canton.edu

User-agent: *
Disallow: /test/
Allow: /

Sitemap: https://www.canton.edu/sitemap.xml
  • код 302 http://canton.edu/robots.txt
  • код 200 https://www.canton.edu/robots.txt