zkhu4d.com robots.txt
Zkhu4d.com has robots.txt file. Http response status is 200.
Robots size is small. It is about 217 kb and 43 rows.
Robots.txt contains very strange content because there only allow rules and no disallow.
Host directive is not presented for domain zkhu4d.com in robots.txt file.
Robots size is small. It is about 217 kb and 43 rows.
Robots.txt contains very strange content because there only allow rules and no disallow.
Host directive is not presented for domain zkhu4d.com in robots.txt file.
Array
(
[*] => Array
(
[allow] => Array
(
[0] => /
)
)
[amazonbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[applebot-extended] => Array
(
[disallow] => Array
(
[0] => /
)
)
[bytespider] => Array
(
[disallow] => Array
(
[0] => /
)
)
[ccbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[claudebot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[cloudflarebrowserrenderingcrawler] => Array
(
[disallow] => Array
(
[0] => /
)
)
[google-extended] => Array
(
[disallow] => Array
(
[0] => /
)
)
[gptbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[meta-externalagent] => Array
(
[disallow] => Array
(
[0] => /
)
)
)
# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding # use. # (b) If a Content-Signal = no, you may not collect content for the # corresponding use. # (c) If the website operator does not include a Content-Signal for a # corresponding use, the website operator neither grants nor restricts # permission via Content-Signal with respect to the corresponding use. # The content signals and their meanings are: # search: building a search index and providing search results (e.g., returning # hyperlinks and short excerpts from your website's contents). Search does not # include providing AI-generated search summaries. # ai-input: inputting content into one or more AI models (e.g., retrieval # augmented generation, grounding, or other real-time taking of content for # generative AI search answers). # ai-train: training or fine-tuning AI models. # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF # RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT # AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET. # BEGIN Cloudflare Managed content User-agent: * Content-Signal: search=yes,ai-train=no Allow: / User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CloudflareBrowserRenderingCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: meta-externalagent Disallow: / # END Cloudflare Managed Content
- код 200 http://zkhu4d.com/robots.txt