upment.com robots.txt
Upment.com has robots.txt file. Http response code is 200.
Robots size is very small. It is about 23 kb and 11 rows.
Host directive is not presented for domain upment.com in robots.txt file.
Robots size is very small. It is about 23 kb and 11 rows.
Host directive is not presented for domain upment.com in robots.txt file.
Array
(
[*] => Array
(
[allow] => Array
(
[0] => /
)
[disallow] => Array
(
[0] => /privacy-policy
)
)
[ahrefsbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[dotbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[rogerbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[semrushbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
)
User-agent: * Allow: / Disallow: /privacy-policy User-agent: AhrefsBot Disallow: / User-agent: dotbot Disallow: / User-agent: rogerbot Disallow: / User-agent: SemrushBot Disallow: /
- код 301 http://upment.com/robots.txt
- код 200 https://upment.com/robots.txt