pineca.se robots.txt
Pineca.se has robots.txt file. Http response status is 200.
Robots size is small. It is about 150 kb and 60 rows.
pineca.se has sitemap file https://www.pineca.se/sitemap.xml. Robots.txt for User-Agent=* contains only disallow directives.
Host directive is not presented for domain pineca.se in robots.txt file.
Robots size is small. It is about 150 kb and 60 rows.
pineca.se has sitemap file https://www.pineca.se/sitemap.xml. Robots.txt for User-Agent=* contains only disallow directives.
Host directive is not presented for domain pineca.se in robots.txt file.
Array
(
[*] => Array
(
[sitemap] => Array
(
[0] => https://www.pineca.se/sitemap.xml
)
[disallow] => Array
(
[0] => /admin/
[1] => /*?*sorting
[2] => /*?*toggle_filter=
[3] => /*?*criteria
[4] => /*?*id=
[5] => /*?*page=
[6] => /index.php/
[7] => */pdf/*
[8] => *.pdf
[9] => /reviews/
[10] => /cart/
[11] => /checkout/
[12] => /message-sent/
[13] => /leads/*
[14] => */assembly-info/pdf
[15] => */assembly-info/export
[16] => /chat/properties
)
)
[dotbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[smtbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[zoominfobot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[aspiegelbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[seznambot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[yak] => Array
(
[disallow] => Array
(
[0] => /
)
)
[mojeekbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[coccocbot-web] => Array
(
[disallow] => Array
(
[0] => /
)
)
[cliqzbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[mail.ru_bot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[adbeat_bot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[tweetmemebot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[surdotlybot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[startmebot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[hubspot crawler] => Array
(
[disallow] => Array
(
[0] => /
)
)
[houzzbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[coccocbot-image] => Array
(
[disallow] => Array
(
[0] => /
)
)
[heurekabot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[seobilitybot] => Array
(
[disallow] => Array
(
[0] => /
)
)
)
User-agent: * Sitemap: https://www.pineca.se/sitemap.xml ## Do not crawl admin page Disallow: /admin/ ## Do not crawl these pages Disallow: /*?*sorting Disallow: /*?*toggle_filter= Disallow: /*?*criteria Disallow: /*?*id= Disallow: /*?*page= Disallow: /index.php/ Disallow: */pdf/* Disallow: *.pdf Disallow: /reviews/ Disallow: /cart/ Disallow: /checkout/ Disallow: /message-sent/ Disallow: /leads/* Disallow: */assembly-info/pdf Disallow: */assembly-info/export Disallow: /chat/properties ## Unwelcome crawlers User-agent: DotBot Disallow: / User-agent: SMTBot Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: AspiegelBot Disallow: / User-agent: SeznamBot Disallow: / User-agent: YaK Disallow: / User-agent: MojeekBot Disallow: / User-agent: coccocbot-web Disallow: / User-agent: Cliqzbot Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: adbeat_bot Disallow: / User-agent: TweetmemeBot Disallow: / User-agent: SurdotlyBot Disallow: / User-agent: startmebot Disallow: / User-agent: hubspot crawler Disallow: / User-agent: houzzbot Disallow: / User-agent: coccocbot-image Disallow: / User-agent: Heurekabot Disallow: / User-agent: SeobilityBot Disallow: /
- код 301 http://pineca.se/robots.txt
- код 200 https://www.pineca.se/robots.txt