mibs.info robots.txt
Mibs.info has robots.txt file. Http response code is 200.
Robots size is very small. It is about 8 kb and 4 rows.
mibs.info has sitemap file /sitemap.xml. Robots.txt contains very strange content because there only allow rules and no disallow.
Host directive is not presented for domain mibs.info in robots.txt file.
Robots size is very small. It is about 8 kb and 4 rows.
mibs.info has sitemap file /sitemap.xml. Robots.txt contains very strange content because there only allow rules and no disallow.
Host directive is not presented for domain mibs.info in robots.txt file.
Array
(
[*] => Array
(
[allow] => Array
(
[0] => /
)
[sitemap] => Array
(
[0] => /sitemap.xml
)
)
)
User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml
- код 200 http://mibs.info/robots.txt