backups.zip robots.txt
Backups.zip has robots.txt file. Http response code is 200.
Robots size is very small. It is about 3 kb and 2 rows.
Robots.txt contains very strange content because there only allow rules and no disallow.
Host directive is not presented for domain backups.zip in robots.txt file.
Robots size is very small. It is about 3 kb and 2 rows.
Robots.txt contains very strange content because there only allow rules and no disallow.
Host directive is not presented for domain backups.zip in robots.txt file.
Array
(
[*] => Array
(
[allow] => Array
(
[0] => /
)
)
)
User-agent: * Allow: /
- код 200 http://backups.zip/robots.txt