Toggle navigation
Robots.txt
Php library
Github
Search
Stars
Forks
Issues
nps.edu
robots.txt
Nps.edu
has robots.txt file. Http response code is 200.
Robots size is very small. It is about 3 kb and 2 rows.
Host
directive is not presented for domain nps.edu in robots.txt file.
Result of parse
Raw robots.txt content
Response analysis
Array ( [*] => Array ( ) )
User-Agent: * Disallow:
код 302
http://nps.edu/robots.txt
код 200
https://nps.edu/robots.txt