Toggle navigation
Robots.txt
Php library
Github
Search
Stars
Forks
Issues
goplacesdigital.com
robots.txt
Goplacesdigital.com
has robots.txt file. Http response code is 200.
Robots size is very small. It is about 4 kb and 2 rows.
Host
directive is not presented for domain goplacesdigital.com in robots.txt file.
Result of parse
Raw robots.txt content
Response analysis
Array ( [*] => Array ( [crawl-delay] => 30 ) )
User-agent: * Crawl-delay: 30
код 200
http://goplacesdigital.com/robots.txt