Codecanyon.net has robots.txt file. Http response status is 200.
Robots size is small. It is about 95 kb and 32 rows.

Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain codecanyon.net in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => *?platform*
                    [1] => */full_screen_preview/
                    [2] => *?sales*
                    [3] => */cart/*
                    [4] => */sign_in?*
                    [5] => */item_support/
                    [6] => /affiliate/
                    [7] => /referral/
                    [8] => /shopfront-api/
                    [9] => /shopfront_api/
                    [10] => /cart/
                    [11] => *?sort=*
                    [12] => *,*,*
                    [13] => *?attribute_key
                    [14] => *\+*\+*
                    [15] => /cart$
                    [16] => /sign_in
                    [17] => /consociate/
                    [18] => *price_min=*
                    [19] => *price_max=*
                    [20] => */screenshots/
                    [21] => /bookmarks/widget
                    [22] => /favorites?
                    [23] => *item_id
                    [24] => /my/*
                    [25] => *discount_type=*
                    [26] => /storefront/
                )

            [sitemap] => Array
                (
                    [0] => https://s3.envato.com/sitemaps/codecanyon.xml.gz
                    [1] => https://codecanyon.net/lp/sitemap.xml
                )

        )

    [pinterest] => Array
        (
            [crawl-delay] => 1
        )

)
User-agent: *

Disallow: *?platform*
Disallow: */full_screen_preview/
Disallow: *?sales*
Disallow: */cart/*
Disallow: */sign_in?*
Disallow: */item_support/
Disallow: /affiliate/
Disallow: /referral/
Disallow: /shopfront-api/
Disallow: /shopfront_api/
Disallow: /cart/
Disallow: *?sort=*
Disallow: *,*,*
Disallow: *?attribute_key
Disallow: *\+*\+*
Disallow: /cart$
Disallow: /sign_in
Disallow: /consociate/
Disallow: *price_min=*
Disallow: *price_max=*
Disallow: */screenshots/
Disallow: /bookmarks/widget
Disallow: /favorites?
Disallow: *item_id
Disallow: /my/*
Disallow: *discount_type=*
Disallow: /storefront/

User-agent: Pinterest
Crawl-delay: 1

Sitemap: https://s3.envato.com/sitemaps/codecanyon.xml.gz
Sitemap: https://codecanyon.net/lp/sitemap.xml
  • код 301 http://codecanyon.net/robots.txt
  • код 200 https://codecanyon.net/robots.txt