pullandbear.com robots.txt
Pullandbear.com has robots.txt file. Http response status is 200.
Robots size is small. It is about 385 kb and 155 rows.
pullandbear.com has great amount of sitemap files — 4: https://www.pullandbear.com/2/info/sitemaps/sitemap-index-home-categories-pb.xml, https://www.pullandbear.com/2/info/sitemaps/sitemap-index-products-pb.xml, https://static.pullandbear.net/2/static2/itxwebstandard/sitemapscustom/custom-sitemaps-pb.xml?v=2 and others. Main host for pullandbear.com is https://www.pullandbear.com.
Robots size is small. It is about 385 kb and 155 rows.
pullandbear.com has great amount of sitemap files — 4: https://www.pullandbear.com/2/info/sitemaps/sitemap-index-home-categories-pb.xml, https://www.pullandbear.com/2/info/sitemaps/sitemap-index-products-pb.xml, https://static.pullandbear.net/2/static2/itxwebstandard/sitemapscustom/custom-sitemaps-pb.xml?v=2 and others. Main host for pullandbear.com is https://www.pullandbear.com.
Array
(
[*] => Array
(
[sitemap] => Array
(
[0] => https://www.pullandbear.com/2/info/sitemaps/sitemap-index-home-categories-pb.xml
[1] => https://www.pullandbear.com/2/info/sitemaps/sitemap-index-products-pb.xml
[2] => https://static.pullandbear.net/2/static2/itxwebstandard/sitemapscustom/custom-sitemaps-pb.xml?v=2
[3] => https://static.pullandbear.net/2/static2/itxwebstandard/sitemapscustom/sitemap-index-blackfriday-pb.xml
)
[disallow] => Array
(
[0] => /partnerships*
[1] => /xx/*
[2] => /xy/*
[3] => /ww/*
[4] => /wy/*
[5] => /wz/*
[6] => /wa/*
[7] => /ad/en/*
[8] => /al/en/*
[9] => /at/en/*
[10] => /am/*
[11] => /az/*
[12] => /ba/en/*
[13] => /be/en/*
[14] => /bg/en/*
[15] => /bh/en/*
[16] => /by/en/*
[17] => /ch/en/*
[18] => /co/*
[19] => /cr/*
[20] => /cy/*
[21] => /cz/en/*
[22] => /de/en/*
[23] => /dk/en/*
[24] => /do/*
[25] => /dz/*
[26] => /ec/*
[27] => /ee/en/*
[28] => /es/en/*
[29] => /es/ca/*
[30] => /fr/en/*
[31] => /ge/*
[32] => /gr/en/*
[33] => /gt/*
[34] => /hk/*
[35] => /hn/*
[36] => /hr/en/*
[37] => /hu/en/*
[38] => /ic/*
[39] => /id/en/*
[40] => /il/en/*
[41] => /it/en/*
[42] => /jo/en/*
[43] => /kw/en/*
[44] => /kz/en/*
[45] => /lb/*
[46] => /lt/en/*
[47] => /lu/*
[48] => /lv/en/*
[49] => /ma/*
[50] => /mc/en/*
[51] => /me/*
[52] => /mk/en/*
[53] => /mx/en/*
[54] => /ni/*
[55] => /nl/en/*
[56] => /ua/en/*
[57] => /om/en/*
[58] => /pa/*
[59] => /pl/en/*
[60] => /pt/en/*
[61] => /ro/en/*
[62] => /rs/en/*
[63] => /sa/en/*
[64] => /se/en/*
[65] => /sk/en/*
[66] => /si/en/*
[67] => /sv/*
[68] => /th/en/*
[69] => /tn/en/*
[70] => /tr/en/*
[71] => /tw/*
[72] => /us/es/*
[73] => /vn/*
[74] => /xk/*
)
[allow] => Array
(
[0] => /co/*-l*
[1] => /kw/en/*-l*
[2] => /th/en/*-l*
)
[host] => https://www.pullandbear.com
)
[ubicrawler] => Array
(
[disallow] => Array
(
[0] => /
)
)
[doc] => Array
(
[disallow] => Array
(
[0] => /
)
)
[zao] => Array
(
[disallow] => Array
(
[0] => /
)
)
[sitecheck.internetseer.com] => Array
(
[disallow] => Array
(
[0] => /
)
)
[zealbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[msiecrawler] => Array
(
[disallow] => Array
(
[0] => /
)
)
[sitesnagger] => Array
(
[disallow] => Array
(
[0] => /
)
)
[webstripper] => Array
(
[disallow] => Array
(
[0] => /
)
)
[webcopier] => Array
(
[disallow] => Array
(
[0] => /
)
)
[fetch] => Array
(
[disallow] => Array
(
[0] => /
)
)
[offline explorer] => Array
(
[disallow] => Array
(
[0] => /
)
)
[teleport] => Array
(
[disallow] => Array
(
[0] => /
)
)
[teleportpro] => Array
(
[disallow] => Array
(
[0] => /
)
)
[webzip] => Array
(
[disallow] => Array
(
[0] => /
)
)
[linko] => Array
(
[disallow] => Array
(
[0] => /
)
)
[httrack] => Array
(
[disallow] => Array
(
[0] => /
)
)
[microsoft.url.control] => Array
(
[disallow] => Array
(
[0] => /
)
)
[xenu] => Array
(
[disallow] => Array
(
[0] => /
)
)
[larbin] => Array
(
[disallow] => Array
(
[0] => /
)
)
[libwww] => Array
(
[disallow] => Array
(
[0] => /
)
)
[zyborg] => Array
(
[disallow] => Array
(
[0] => /
)
)
[download ninja] => Array
(
[disallow] => Array
(
[0] => /
)
)
[fast] => Array
(
[disallow] => Array
(
[0] => /
)
)
[slurp] => Array
(
[disallow] => Array
(
[0] => /
)
)
[maxthon] => Array
(
[disallow] => Array
(
[0] => /
)
)
[cncdialer] => Array
(
[disallow] => Array
(
[0] => /
)
)
[mj12bot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[yandex] => Array
(
[disallow] => Array
(
[0] => /itxrest
)
)
[proximic] => Array
(
[disallow] => Array
(
[0] => /itxrest
)
)
[oai-searchbot] => Array
(
[allow] => Array
(
[0] => /
)
)
[chatgpt-user] => Array
(
[allow] => Array
(
[0] => /
)
)
[perplexitybot] => Array
(
[allow] => Array
(
[0] => /
)
)
[claude-web] => Array
(
[allow] => Array
(
[0] => /
)
)
[applebot] => Array
(
[allow] => Array
(
[0] => /
)
)
[googleother] => Array
(
[allow] => Array
(
[0] => /
)
)
)
Sitemap: https://www.pullandbear.com/2/info/sitemaps/sitemap-index-home-categories-pb.xml Sitemap: https://www.pullandbear.com/2/info/sitemaps/sitemap-index-products-pb.xml Sitemap: https://static.pullandbear.net/2/static2/itxwebstandard/sitemapscustom/custom-sitemaps-pb.xml?v=2 Sitemap: https://static.pullandbear.net/2/static2/itxwebstandard/sitemapscustom/sitemap-index-blackfriday-pb.xml #Bots de que no nos interesa que nos recorran User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-agent: fast Disallow: / User-agent: Slurp Disallow: / User-agent: Maxthon Disallow: / User-agent: CNCDialer Disallow: / User-agent: MJ12bot Disallow: / User-agent: Yandex Disallow: /itxrest User-agent: proximic Disallow: /itxrest User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Claude-Web Allow: / User-agent: Applebot Allow: / User-agent: GoogleOther Allow: / User-agent: * Disallow: /partnerships* Disallow: /xx/* Disallow: /xy/* Disallow: /ww/* Disallow: /wy/* Disallow: /wz/* Disallow: /wa/* Disallow: /ad/en/* Disallow: /al/en/* Disallow: /at/en/* Disallow: /am/* Disallow: /az/* Disallow: /ba/en/* Disallow: /be/en/* Disallow: /bg/en/* Disallow: /bh/en/* Disallow: /by/en/* Disallow: /ch/en/* Disallow: /co/* Allow: /co/*-l* Disallow: /cr/* Disallow: /cy/* Disallow: /cz/en/* Disallow: /de/en/* Disallow: /dk/en/* Disallow: /do/* Disallow: /dz/* Disallow: /ec/* Disallow: /ee/en/* Disallow: /es/en/* Disallow: /es/ca/* Disallow: /fr/en/* Disallow: /ge/* Disallow: /gr/en/* Disallow: /gt/* Disallow: /hk/* Disallow: /hn/* Disallow: /hr/en/* Disallow: /hu/en/* Disallow: /ic/* Disallow: /id/en/* Disallow: /il/en/* Disallow: /it/en/* Disallow: /jo/en/* Disallow: /kw/en/* Allow: /kw/en/*-l* Disallow: /kz/en/* Disallow: /lb/* Disallow: /lt/en/* Disallow: /lu/* Disallow: /lv/en/* Disallow: /ma/* Disallow: /mc/en/* Disallow: /me/* Disallow: /mk/en/* Disallow: /mx/en/* Disallow: /ni/* Disallow: /nl/en/* Disallow: /ua/en/* Disallow: /om/en/* Disallow: /pa/* Disallow: /pl/en/* Disallow: /pt/en/* Disallow: /ro/en/* Disallow: /rs/en/* Disallow: /sa/en/* Disallow: /se/en/* Disallow: /sk/en/* Disallow: /si/en/* Disallow: /sv/* Disallow: /th/en/* Allow: /th/en/*-l* Disallow: /tn/en/* Disallow: /tr/en/* Disallow: /tw/* Disallow: /us/es/* Disallow: /vn/* Disallow: /xk/* Host: https://www.pullandbear.com
- код 301 http://pullandbear.com/robots.txt
- код 301 https://pullandbear.com/robots.txt
- код 200 https://www.pullandbear.com/robots.txt