website.zip robots.txt
Website.zip has robots.txt file. Http response code is 200.
Robots size is very small. It is about 3 kb and 2 rows.
Robots.txt contains very strange content because there only allow rules and no disallow.
Host directive is not presented for domain website.zip in robots.txt file.
Robots size is very small. It is about 3 kb and 2 rows.
Robots.txt contains very strange content because there only allow rules and no disallow.
Host directive is not presented for domain website.zip in robots.txt file.
Array
(
[*] => Array
(
[allow] => Array
(
[0] => /
)
)
)
User-agent: * Allow: /
- код 200 http://website.zip/robots.txt