linge.biz robots.txt
Linge.biz has robots.txt file. Http response code is 200.
Robots size is small. It is about 171 kb and 68 rows.
linge.biz has sitemap file https://linge.biz/sitemap_default.xml. Main host for linge.biz is https://linge.biz.
linge.biz has separate rules for googlebot and yandexbot and also has rules for all bots (User-Agent=*).
Robots size is small. It is about 171 kb and 68 rows.
linge.biz has sitemap file https://linge.biz/sitemap_default.xml. Main host for linge.biz is https://linge.biz.
linge.biz has separate rules for googlebot and yandexbot and also has rules for all bots (User-Agent=*).
Array
(
[yandex] => Array
(
[allow] => Array
(
[0] => /uploads/
[1] => *.css
[2] => *.js
[3] => *.jpg
[4] => *.JPG
[5] => *.svg
)
[disallow] => Array
(
[0] => /install*
[1] => /mg-admin*
[2] => /personal*
[3] => /enter*
[4] => /forgotpass*
[5] => /payment*
[6] => /registration*
[7] => /compare*
[8] => /cart*
[9] => /*?*lp*
[10] => *applyFilter=*
[11] => *?inCartProductId=*
[12] => *?inCompareProductId=*
[13] => /contacts
)
)
[*] => Array
(
[allow] => Array
(
[0] => /uploads/
[1] => /*.js
[2] => /*.css
[3] => /*.jpg
[4] => /*.gif
[5] => /*.png
[6] => /*.svg
[7] => *engine-script-LANG.js*
[8] => *engine-script.js*
)
[disallow] => Array
(
[0] => /install*
[1] => /mg-admin*
[2] => /personal*
[3] => /enter*
[4] => /forgotpass*
[5] => /payment*
[6] => /registration*
[7] => /compare*
[8] => /cart*
[9] => /*?*lp*
[10] => *applyFilter=*
[11] => *?inCartProductId=*
[12] => *?inCompareProductId=*
[13] => /any-page.html?
[14] => /contacts
)
[sitemap] => Array
(
[0] => https://linge.biz/sitemap_default.xml
)
[host] => https://linge.biz
)
[googlebot] => Array
(
[allow] => Array
(
[0] => *.css
[1] => *.js
[2] => *.jpg
[3] => *.JPG
[4] => *.svg
[5] => /mg-core/script/*.js
[6] => *engine-script-LANG.js*
)
[disallow] => Array
(
[0] => /*?
[1] => /mg-formvalid
[2] => /any-page.html?
[3] => /contacts
)
)
[yahoo] => Array
(
[disallow] => Array
(
[0] => /
)
)
[mj12bot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[mediapartners-google] => Array
(
[disallow] => Array
(
[0] => /
)
)
[ahrefsbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
)
User-agent: Yandex Allow: /uploads/ Allow: *.css Allow: *.js Allow: *.jpg Allow: *.JPG Allow: *.svg Disallow: /install* Disallow: /mg-admin* Disallow: /personal* Disallow: /enter* Disallow: /forgotpass* Disallow: /payment* Disallow: /registration* Disallow: /compare* Disallow: /cart* Disallow: /*?*lp* Disallow: *applyFilter=* Disallow: *?inCartProductId=* Disallow: *?inCompareProductId=* Disallow: /contacts User-agent: * Allow: /uploads/ Allow: /*.js Allow: /*.css Allow: /*.jpg Allow: /*.gif Allow: /*.png Allow: /*.svg Allow: *engine-script-LANG.js* Allow: *engine-script.js* Disallow: /install* Disallow: /mg-admin* Disallow: /personal* Disallow: /enter* Disallow: /forgotpass* Disallow: /payment* Disallow: /registration* Disallow: /compare* Disallow: /cart* Disallow: /*?*lp* Disallow: *applyFilter=* Disallow: *?inCartProductId=* Disallow: *?inCompareProductId=* Disallow: /any-page.html? Disallow: /contacts User-agent: Googlebot Allow: *.css Allow: *.js Allow: *.jpg Allow: *.JPG Allow: *.svg Allow: /mg-core/script/*.js Allow: *engine-script-LANG.js* Disallow: /*? Disallow: /mg-formvalid Disallow: /any-page.html? Disallow: /contacts Sitemap: https://linge.biz/sitemap_default.xml Host: https://linge.biz User-agent: Yahoo Disallow: / User-agent: MJ12bot Disallow: / User-agent: Mediapartners-Google Disallow: / User-agent: AhrefsBot Disallow: /
- код 301 http://linge.biz/robots.txt
- код 200 https://linge.biz/robots.txt