Toggle navigation
Robots.txt
Php library
Github
Search
Stars
Forks
Issues
le-club-immobilier.be
robots.txt
Le-club-immobilier.be
has robots.txt file. Http response code is 200.
Robots size is very small. It is about 4 kb and 2 rows.
Host
directive is not presented for domain le-club-immobilier.be in robots.txt file.
Result of parse
Raw robots.txt content
Response analysis
Array ( [*] => Array ( [crawl-delay] => 10 ) )
User-agent: * Crawl-delay: 10
код 200
http://le-club-immobilier.be/robots.txt