artelamp.ru robots.txt
Artelamp.ru has robots.txt file. Http response status is 200.
Robots size is small. It is about 546 kb and 191 rows.
artelamp.ru has sitemap file https://artelamp.ru/sitemap.xml. Host directive is not presented for domain artelamp.ru in robots.txt file.
Robots size is small. It is about 546 kb and 191 rows.
artelamp.ru has sitemap file https://artelamp.ru/sitemap.xml. Host directive is not presented for domain artelamp.ru in robots.txt file.
Array
(
[*] => Array
(
[disallow] => Array
(
[0] => /auth
[1] => /core/
[2] => /manager/
[3] => /connectors/
[4] => /profile/
[5] => /basket/
[6] => /favorites/
[7] => /comparison/
[8] => /search/
[9] => /inc/
[10] => /assets/
[11] => /index.php
[12] => *?
[13] => /*sortby
[14] => /*page
[15] => /*&source
[16] => /*&search
[17] => /*&lr
[18] => /assets/images/products/*/big/*?
)
[allow] => Array
(
[0] => /*.js
[1] => /*.css
[2] => /assets/images/products/*/big/
)
[sitemap] => Array
(
[0] => https://artelamp.ru/sitemap.xml
)
)
[sistrix] => Array
(
[disallow] => Array
(
[0] => /
)
)
[sistrix crawler] => Array
(
[disallow] => Array
(
[0] => /
)
)
[seokicks-robot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[jobs.de-robot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[ahrefsbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[unisterbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[dotbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[searchmetricsbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[mj12bot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[surveybot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[seodiver] => Array
(
[disallow] => Array
(
[0] => /
)
)
[spbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[wotbox] => Array
(
[disallow] => Array
(
[0] => /
)
)
[meanpathbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[backlinkcrawler] => Array
(
[disallow] => Array
(
[0] => /
)
)
[magpie-crawler] => Array
(
[disallow] => Array
(
[0] => /
)
)
[obot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[fr-crawler] => Array
(
[disallow] => Array
(
[0] => /
)
)
[blexbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[megaindex.ru] => Array
(
[disallow] => Array
(
[0] => /
)
)
[megaindex.com] => Array
(
[disallow] => Array
(
[0] => /
)
)
[cloudservermarketspider] => Array
(
[disallow] => Array
(
[0] => /
)
)
[trendictionbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[exabot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[careerbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[lipperhey-kaus-australis] => Array
(
[disallow] => Array
(
[0] => /
)
)
[seoscanners.net] => Array
(
[disallow] => Array
(
[0] => /
)
)
[metajobbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[spiderbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[linkstats] => Array
(
[disallow] => Array
(
[0] => /
)
)
[jobboersebot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[iccrawler] => Array
(
[disallow] => Array
(
[0] => /
)
)
[plista] => Array
(
[disallow] => Array
(
[0] => /
)
)
[domain re-animator bot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[turnitinbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[coccoc] => Array
(
[disallow] => Array
(
[0] => /
)
)
[um-ic] => Array
(
[disallow] => Array
(
[0] => /
)
)
[mindupbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[sg-orbiter] => Array
(
[disallow] => Array
(
[0] => /
)
)
[ccbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[qwantify] => Array
(
[disallow] => Array
(
[0] => /
)
)
[kraken] => Array
(
[disallow] => Array
(
[0] => /
)
)
[plukkie] => Array
(
[disallow] => Array
(
[0] => /
)
)
[safednsbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[360spider] => Array
(
[disallow] => Array
(
[0] => /
)
)
[haosouspider] => Array
(
[disallow] => Array
(
[0] => /
)
)
[rogerbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[openhosebot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[screaming frog seo spider] => Array
(
[disallow] => Array
(
[0] => /
)
)
[thumbsniper] => Array
(
[disallow] => Array
(
[0] => /
)
)
[r6_commentreader] => Array
(
[disallow] => Array
(
[0] => /
)
)
[implisensebot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[cliqzbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[aihitbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
[wbsearchbot] => Array
(
[disallow] => Array
(
[0] => /
)
)
)
User-agent: * Disallow: /auth Disallow: /core/ Disallow: /manager/ Disallow: /connectors/ Disallow: /profile/ Disallow: /basket/ Disallow: /favorites/ Disallow: /comparison/ Disallow: /search/ Disallow: /inc/ Disallow: /assets/ Disallow: /index.php Disallow: *? Disallow: /*sortby Disallow: /*page Disallow: /*&source Disallow: /*&search Disallow: /*&lr Allow: /*.js Allow: /*.css Allow: /assets/images/products/*/big/ Disallow: /assets/images/products/*/big/*? # Disallow: Sistrix User-agent: sistrix Disallow: / # Disallow: Sistrix User-agent: SISTRIX Crawler Disallow: / # Disallow: Sistrix User-agent: SISTRIX Disallow: / # Disallow: SEOkicks-Robot User-agent: SEOkicks-Robot Disallow: / # Disallow: jobs.de-Robot User-agent: jobs.de-Robot Disallow: / # Backlink Analysis user-agent: AhrefsBot disallow: / # Bot der Leipziger Unister Holding GmbH user-agent: UnisterBot disallow: / # http://moz.com/products User-agent: dotbot Disallow: / # http://www.searchmetrics.com User-agent: SearchmetricsBot Disallow: / # http://www.majestic12.co.uk/projects/dsearch/mj12bot.php User-agent: MJ12bot Disallow: / # http://www.domaintools.com/webmasters/surveybot.php User-agent: SurveyBot Disallow: / # http://www.seodiver.com/bot user-agent: SEOdiver disallow: / # http://openlinkprofiler.org/bot User-agent: spbot Disallow: / # http://www.wotbox.com/bot/ User-agent: wotbox Disallow: / # http://www.opensiteexplorer.org/dotbot # http://moz.com/researchtools/ose/dotbot User-agent: dotbot Disallow: / # http://www.meanpath.com/meanpathbot.html User-agent: meanpathbot Disallow: / # http://www.backlinktest.com/crawler.html User-agent: BacklinkCrawler Disallow: / # http://www.brandwatch.com/magpie-crawler/ User-agent: magpie-crawler Disallow: / # http://filterdb.iss.net/crawler/ User-agent: oBot Disallow: / User-agent: fr-crawler Disallow: / # http://webmeup-crawler.com User-agent: BLEXBot Disallow: / # https://megaindex.com/crawler User-agent: MegaIndex.ru Disallow: / User-agent: megaindex.com Disallow: / # http://www.cloudservermarket.com User-Agent: CloudServerMarketSpider Disallow: / # http://www.trendiction.de/de/publisher/bot User-Agent: trendictionbot Disallow: / # http://www.exalead.com User-agent: Exabot Disallow: / # http://www.career-x.de/bot.html User-agent: careerbot Disallow: / # https://www.lipperhey.com/en/about/ User-agent: Lipperhey-Kaus-Australis Disallow: / User-agent: seoscanners.net Disallow: / User-agent: MetaJobBot Disallow: / User-agent: Spiderbot Disallow: / User-agent: LinkStats Disallow: / User-agent: JobboerseBot Disallow: / User-agent: ICCrawler Disallow: / User-agent: Plista Disallow: / User-agent: Domain Re-Animator Bot Disallow: / # https://www.lipperhey.com/en/about/ User-agent: Lipperhey-Kaus-Australis Disallow: / # https://turnitin.com/robot/crawlerinfo.html User-agent: turnitinbot Disallow: / # http://help.coccoc.com/ User-agent: coccoc Disallow: / # ubermetrics-technologies.com User-agent: um-IC Disallow: / # datenbutler.de User-agent: mindUpBot Disallow: / # http://searchgears.de/uber-uns/crawling-faq.html User-agent: sg-Orbiter Disallow: / # http://commoncrawl.org/faq/ User-agent: CCBot Disallow: / # https://www.qwant.com/ User-agent: Qwantify Disallow: / # http://linkfluence.net/ User-agent: Kraken Disallow: / # http://www.botje.com/plukkie.htm User-agent: plukkie Disallow: / # https://www.safedns.com/searchbot User-agent: SafeDNSBot Disallow: / # http://www.haosou.com/help/help_3_2.html User-agent: 360Spider Disallow: / # http://www.haosou.com/help/help_3_2.html User-agent: HaosouSpider Disallow: / # http://www.moz.com/dp/rogerbot User-agent: rogerbot Disallow: / # http://www.openhose.org/bot.html User-agent: OpenHoseBot Disallow: / # http://www.screamingfrog.co.uk/seo-spider/ User-agent: Screaming Frog SEO Spider Disallow: / # http://thumbsniper.com User-agent: ThumbSniper Disallow: / # http://www.radian6.com/crawler User-agent: R6_CommentReader Disallow: / User-agent: ImplisenseBot Disallow: / # http://cliqz.com/company/cliqzbot User-agent: Cliqzbot Disallow: / # https://www.aihitdata.com/about User-agent: aiHitBot Disallow: / # http://www.trendiction.com/en/publisher/bot User-Agent: trendictionbot Disallow: / # http://warebay.com/bot.html User-agent: WBSearchBot Disallow: / Sitemap: https://artelamp.ru/sitemap.xml
- код 302 http://artelamp.ru/robots.txt
- код 200 https://artelamp.ru/robots.txt