google.it robots.txt
Google.it has robots.txt file. Http response code is 200.
Robots size is medium. It is about 813 kb and 254 rows.
google.it has sitemap file https://www.google.com/sitemap.xml. Host directive is not presented for domain google.it in robots.txt file.
Robots size is medium. It is about 813 kb and 254 rows.
google.it has sitemap file https://www.google.com/sitemap.xml. Host directive is not presented for domain google.it in robots.txt file.
Array
(
[*] => Array
(
[sitemap] => Array
(
[0] => https://www.google.com/sitemap.xml
)
)
[yandex] => Array
(
[disallow] => Array
(
[0] => /search
[1] => /sdch
[2] => /groups
[3] => /index.html?
[4] => /?
[5] => /?hl=*&
[6] => /?hl=*&*&gws_rd=ssl
[7] => /imgres
[8] => /u/
[9] => /setprefs
[10] => /m?
[11] => /m/
[12] => /wml?
[13] => /wml/?
[14] => /wml/search?
[15] => /xhtml?
[16] => /xhtml/?
[17] => /xhtml/search?
[18] => /xml?
[19] => /imode?
[20] => /imode/?
[21] => /imode/search?
[22] => /jsky?
[23] => /jsky/?
[24] => /jsky/search?
[25] => /pda?
[26] => /pda/?
[27] => /pda/search?
[28] => /local?
[29] => /local_url
[30] => /products?
[31] => /product_
[32] => /products_
[33] => /products;
[34] => /print
[35] => /books/
[36] => /bkshp?*dq=
[37] => /bkshp?*q=
[38] => /books?*dq=
[39] => /books?*q=
[40] => /books?*qtid=
[41] => /books?*output=
[42] => /books?*pg=
[43] => /books?*jtp=
[44] => /books?*jscmd=
[45] => /books?*buy=
[46] => /books?*zoom=
[47] => /patents?
[48] => /patents/download/
[49] => /patents/pdf/
[50] => /patents/related/
[51] => /scholar
[52] => /citations?
[53] => /s?
[54] => /maps?
[55] => /mapslt?
[56] => /maphp?
[57] => /maps/
[58] => /maps/api/js/
[59] => /mld?
[60] => /staticmap?
[61] => /help/maps/streetview/partners/welcome/
[62] => /help/maps/indoormaps/partners/
[63] => /lochp?
[64] => /ie?
[65] => /uds/
[66] => /transit?
[67] => /trends?
[68] => /trends/music?
[69] => /trends/hottrends?
[70] => /trends/viz?
[71] => /trends/embed.js?
[72] => /trends/fetchComponent?
[73] => /trends/beta
[74] => /trends/topics
[75] => /trends/explore?
[76] => /trends/api
[77] => /musica
[78] => /musicl
[79] => /musics
[80] => /urchin_test/
[81] => /movies?
[82] => /wapsearch?
[83] => /reviews/search?
[84] => /cbk
[85] => /profiles/me
[86] => /s2/profiles/me
[87] => /s2
[88] => /transconsole/portal/
[89] => /aclk
[90] => /tbproxy/
[91] => /support/forum/search?
[92] => /reviews/polls/
[93] => /hosted/images/
[94] => /accounts/ClientLogin
[95] => /accounts/ClientAuth
[96] => /accounts/o8
[97] => /quality_form?
[98] => /labs/popgadget/search
[99] => /compressiontest/
[100] => /analytics/feeds/
[101] => /analytics/partners/comments/
[102] => /analytics/portal/
[103] => /analytics/uploads/
[104] => /alerts/
[105] => /phone/compare/?
[106] => /travel/clk
[107] => /travel/entity
[108] => /travel/search
[109] => /travel/flights/booking
[110] => /travel/flights/s/
[111] => /travel/flights/search
[112] => /travel/hotels/stories
[113] => /travel/hotels/*/stories
[114] => /travel/story
[115] => /hotelfinder/rpc
[116] => /hotels/rpc
[117] => /evaluation/
[118] => /forms/perks/
[119] => /shopping/suppliers/search
[120] => /edu/cs4hs/
[121] => /trustedstores/s/
[122] => /trustedstores/tm2
[123] => /trustedstores/verify
[124] => /shopping?
[125] => /shopping/product/
[126] => /shopping/seller
[127] => /shopping/ratings/account/metrics
[128] => /shopping/ratings/merchant/immersivedetails
[129] => /shopping/reviewer
[130] => /shopping/search
[131] => /shopping/deals
[132] => /storefront
[133] => /storepicker
[134] => /about/careers/applications/candidate-prep
[135] => /about/careers/applications/connect-with-a-googler
[136] => /about/careers/applications/jobs/results?page=
[137] => /about/careers/applications/jobs/results/?page=
[138] => /about/careers/applications/jobs/results?*&page=
[139] => /about/careers/applications/jobs/results/?*&page=
[140] => /landing/signout.html
[141] => /gallery/
[142] => /landing/now/ontap/
[143] => /maps/reserve/api/
[144] => /maps/reserve/search
[145] => /maps/reserve/bookings
[146] => /maps/reserve/settings
[147] => /maps/reserve/manage
[148] => /maps/reserve/payment
[149] => /maps/reserve/receipt
[150] => /maps/reserve/sellersignup
[151] => /maps/reserve/feedback
[152] => /maps/reserve/terms
[153] => /maps/reserve/m/
[154] => /maps/reserve/b/
[155] => /maps/reserve/partner-dashboard
[156] => /local/cars
[157] => /local/dealership/
[158] => /local/dining/
[159] => /local/place/products/
[160] => /local/place/reviews/
[161] => /local/place/rap/
[162] => /local/tab/
[163] => /localservices/
[164] => /nonprofits/account/
[165] => /uviewer
[166] => /landing/cmsnext-root/
[167] => /about/careers/applications/jobs/results
[168] => /about/careers/applications-a/jobs/results
)
[allow] => Array
(
[0] => /search/about
[1] => /search/howsearchworks
[2] => /?hl=
[3] => /?hl=*&gws_rd=ssl$
[4] => /?gws_rd=ssl$
[5] => /?pt1=true$
[6] => /m/finance
[7] => /books/about
[8] => /books?*zoom=1
[9] => /books?*zoom=5
[10] => /books/content?*zoom=1
[11] => /books/content?*zoom=5
[12] => /citations?user=
[13] => /citations?view_op=new_profile
[14] => /citations?view_op=top_venues
[15] => /scholar_share
[16] => /maps?daddr=
[17] => /maps?entry=wc
[18] => /maps?f=
[19] => /maps?hl=
[20] => /maps?q=
[21] => /maps?saddr=
[22] => /maps?sid=
[23] => /maps?*output=classic
[24] => /maps?*file=
[25] => /maps/$
[26] => /maps/@
[27] => /maps/?daddr=
[28] => /maps/?entry=wc
[29] => /maps/?f=
[30] => /maps/?hl=
[31] => /maps/?q=
[32] => /maps/?saddr=
[33] => /maps/?sid=
[34] => /maps/search/
[35] => /maps/sitemap.xml
[36] => /maps/sitemaps/
[37] => /maps/dir/
[38] => /maps/d/
[39] => /maps/reserve
[40] => /maps/about
[41] => /maps/contrib/
[42] => /maps/match
[43] => /maps/place/
[44] => /maps/_/
[45] => /search?*tbm=map
[46] => /maps/vt?
[47] => /maps/preview
[48] => /maps/api/js
[49] => /s2/profiles
[50] => /s2/oz
[51] => /s2/photos
[52] => /s2/search/social
[53] => /s2/static
[54] => /accounts/o8/id
[55] => /alerts/manage
[56] => /alerts/remove
[57] => /alerts/$
[58] => /shopping?udm=28$
[59] => /maps/reserve/partners
)
)
[adsbot-google] => Array
(
[disallow] => Array
(
[0] => /maps/api/js/
[1] => /maps/api/place/js/
[2] => /maps/api/staticmap
[3] => /maps/api/streetview
)
[allow] => Array
(
[0] => /maps/api/js
)
)
[facebookexternalhit] => Array
(
)
[twitterbot] => Array
(
[allow] => Array
(
[0] => /imgres
[1] => /search
)
[disallow] => Array
(
[0] => /groups
[1] => /hosted/images/
[2] => /m/
)
)
)
User-agent: * User-agent: Yandex Disallow: /search Allow: /search/about Allow: /search/howsearchworks Disallow: /sdch Disallow: /groups Disallow: /index.html? Disallow: /? Allow: /?hl= Disallow: /?hl=*& Allow: /?hl=*&gws_rd=ssl$ Disallow: /?hl=*&*&gws_rd=ssl Allow: /?gws_rd=ssl$ Allow: /?pt1=true$ Disallow: /imgres Disallow: /u/ Disallow: /setprefs Disallow: /m? Disallow: /m/ Allow: /m/finance Disallow: /wml? Disallow: /wml/? Disallow: /wml/search? Disallow: /xhtml? Disallow: /xhtml/? Disallow: /xhtml/search? Disallow: /xml? Disallow: /imode? Disallow: /imode/? Disallow: /imode/search? Disallow: /jsky? Disallow: /jsky/? Disallow: /jsky/search? Disallow: /pda? Disallow: /pda/? Disallow: /pda/search? Disallow: /local? Disallow: /local_url Disallow: /products? Disallow: /product_ Disallow: /products_ Disallow: /products; Disallow: /print Disallow: /books/ Disallow: /bkshp?*dq= Disallow: /bkshp?*q= Disallow: /books?*dq= Disallow: /books?*q= Disallow: /books?*qtid= Disallow: /books?*output= Disallow: /books?*pg= Disallow: /books?*jtp= Disallow: /books?*jscmd= Disallow: /books?*buy= Disallow: /books?*zoom= Allow: /books/about Allow: /books?*zoom=1 Allow: /books?*zoom=5 Allow: /books/content?*zoom=1 Allow: /books/content?*zoom=5 Disallow: /patents? Disallow: /patents/download/ Disallow: /patents/pdf/ Disallow: /patents/related/ Disallow: /scholar Disallow: /citations? Allow: /citations?user= Allow: /citations?view_op=new_profile Allow: /citations?view_op=top_venues Allow: /scholar_share Disallow: /s? Disallow: /maps? Allow: /maps?daddr= Allow: /maps?entry=wc Allow: /maps?f= Allow: /maps?hl= Allow: /maps?q= Allow: /maps?saddr= Allow: /maps?sid= Allow: /maps?*output=classic Allow: /maps?*file= Disallow: /mapslt? Disallow: /maphp? Disallow: /maps/ Allow: /maps/$ Allow: /maps/@ Allow: /maps/?daddr= Allow: /maps/?entry=wc Allow: /maps/?f= Allow: /maps/?hl= Allow: /maps/?q= Allow: /maps/?saddr= Allow: /maps/?sid= Allow: /maps/search/ Allow: /maps/sitemap.xml Allow: /maps/sitemaps/ Allow: /maps/dir/ Allow: /maps/d/ Allow: /maps/reserve Allow: /maps/about Allow: /maps/contrib/ Allow: /maps/match Allow: /maps/place/ Allow: /maps/_/ Allow: /search?*tbm=map Allow: /maps/vt? Allow: /maps/preview Disallow: /maps/api/js/ Allow: /maps/api/js Disallow: /mld? Disallow: /staticmap? Disallow: /help/maps/streetview/partners/welcome/ Disallow: /help/maps/indoormaps/partners/ Disallow: /lochp? Disallow: /ie? Disallow: /uds/ Disallow: /transit? Disallow: /trends? Disallow: /trends/music? Disallow: /trends/hottrends? Disallow: /trends/viz? Disallow: /trends/embed.js? Disallow: /trends/fetchComponent? Disallow: /trends/beta Disallow: /trends/topics Disallow: /trends/explore? Disallow: /trends/api Disallow: /musica Disallow: /musicl Disallow: /musics Disallow: /urchin_test/ Disallow: /movies? Disallow: /wapsearch? Disallow: /reviews/search? Disallow: /cbk Disallow: /profiles/me Disallow: /s2/profiles/me Allow: /s2/profiles Allow: /s2/oz Allow: /s2/photos Allow: /s2/search/social Allow: /s2/static Disallow: /s2 Disallow: /transconsole/portal/ Disallow: /aclk Disallow: /tbproxy/ Disallow: /support/forum/search? Disallow: /reviews/polls/ Disallow: /hosted/images/ Disallow: /accounts/ClientLogin Disallow: /accounts/ClientAuth Disallow: /accounts/o8 Allow: /accounts/o8/id Disallow: /quality_form? Disallow: /labs/popgadget/search Disallow: /compressiontest/ Disallow: /analytics/feeds/ Disallow: /analytics/partners/comments/ Disallow: /analytics/portal/ Disallow: /analytics/uploads/ Allow: /alerts/manage Allow: /alerts/remove Disallow: /alerts/ Allow: /alerts/$ Disallow: /phone/compare/? Disallow: /travel/clk Disallow: /travel/entity Disallow: /travel/search Disallow: /travel/flights/booking Disallow: /travel/flights/s/ Disallow: /travel/flights/search Disallow: /travel/hotels/stories Disallow: /travel/hotels/*/stories Disallow: /travel/story Disallow: /hotelfinder/rpc Disallow: /hotels/rpc Disallow: /evaluation/ Disallow: /forms/perks/ Disallow: /shopping/suppliers/search Disallow: /edu/cs4hs/ Disallow: /trustedstores/s/ Disallow: /trustedstores/tm2 Disallow: /trustedstores/verify Disallow: /shopping? Disallow: /shopping/product/ Disallow: /shopping/seller Disallow: /shopping/ratings/account/metrics Disallow: /shopping/ratings/merchant/immersivedetails Disallow: /shopping/reviewer Disallow: /shopping/search Disallow: /shopping/deals Allow: /shopping?udm=28$ Disallow: /storefront Disallow: /storepicker Disallow: /about/careers/applications/candidate-prep Disallow: /about/careers/applications/connect-with-a-googler Disallow: /about/careers/applications/jobs/results?page= Disallow: /about/careers/applications/jobs/results/?page= Disallow: /about/careers/applications/jobs/results?*&page= Disallow: /about/careers/applications/jobs/results/?*&page= Disallow: /landing/signout.html Disallow: /gallery/ Disallow: /landing/now/ontap/ Allow: /maps/reserve Allow: /maps/reserve/partners Disallow: /maps/reserve/api/ Disallow: /maps/reserve/search Disallow: /maps/reserve/bookings Disallow: /maps/reserve/settings Disallow: /maps/reserve/manage Disallow: /maps/reserve/payment Disallow: /maps/reserve/receipt Disallow: /maps/reserve/sellersignup Disallow: /maps/reserve/feedback Disallow: /maps/reserve/terms Disallow: /maps/reserve/m/ Disallow: /maps/reserve/b/ Disallow: /maps/reserve/partner-dashboard Disallow: /local/cars Disallow: /local/dealership/ Disallow: /local/dining/ Disallow: /local/place/products/ Disallow: /local/place/reviews/ Disallow: /local/place/rap/ Disallow: /local/tab/ Disallow: /localservices/ Disallow: /nonprofits/account/ Disallow: /uviewer Disallow: /landing/cmsnext-root/ # AdsBot User-agent: AdsBot-Google Disallow: /maps/api/js/ Allow: /maps/api/js Disallow: /maps/api/place/js/ Disallow: /maps/api/staticmap Disallow: /maps/api/streetview # New user agent groups must also have a user agent reference in the global (*) # group. See "Order of precedence" section in # https://goo.gle/rep#order-of-precedence-for-user-agents User-agent: Yandex Disallow: /about/careers/applications/jobs/results Disallow: /about/careers/applications-a/jobs/results # Crawlers of certain social media sites are allowed to access page markup when # google.com/imgres* links are shared. To learn more, please contact # images-robots-allowlist@google.com. User-agent: facebookexternalhit User-agent: Twitterbot Allow: /imgres Allow: /search Disallow: /groups Disallow: /hosted/images/ Disallow: /m/ Sitemap: https://www.google.com/sitemap.xml
- код 301 http://google.it/robots.txt
- код 200 https://www.google.it/robots.txt