Toggle navigation
Robots.txt
Php library
Github
Search
Stars
Forks
Issues
gitflic.ru
robots.txt
Gitflic.ru
has robots.txt file. Http response code is 200.
Robots size is very small. It is about 3 kb and 2 rows.
Robots.txt contains very strange content because there only allow rules and no disallow.
Host
directive is not presented for domain gitflic.ru in robots.txt file.
Result of parse
Raw robots.txt content
Response analysis
Array ( [*] => Array ( [allow] => Array ( [0] => / ) ) )
User-agent: * Allow: /
код 301
http://gitflic.ru/robots.txt
код 200
https://gitflic.ru/robots.txt