Fxclub.org has robots.txt file. Http response code is 200.
Robots size is small. It is about 199 kb and 70 rows.

fxclub.org has sitemap file https://www.fxclub.org/sitemap.xml. Host directive is not presented for domain fxclub.org in robots.txt file.
Array
(
    [*] => Array
        (
            [allow] => Array
                (
                    [0] => /misc/*.js
                    [1] => /misc/*.css
                    [2] => /misc/*.png
                    [3] => /misc/*.svg
                    [4] => /misc/*.jpg
                    [5] => /sites/*.js
                    [6] => /sites/*.css
                    [7] => /sites/*.png
                    [8] => /sites/*.svg
                    [9] => /sites/*.jpg
                )

            [disallow] => Array
                (
                    [0] => */language
                    [1] => */includes/
                    [2] => */misc/
                    [3] => */modules/
                    [4] => */profiles/
                    [5] => */scripts/
                    [6] => */themes/
                    [7] => */CHANGELOG.txt
                    [8] => */cron.php
                    [9] => */INSTALL.mysql.txt
                    [10] => */INSTALL.pgsql.txt
                    [11] => */install.php
                    [12] => */INSTALL.txt
                    [13] => */LICENSE.txt
                    [14] => */MAINTAINERS.txt
                    [15] => */update.php
                    [16] => */UPGRADE.txt
                    [17] => */xmlrpc.php
                    [18] => */admin/
                    [19] => */comment/reply/
                    [20] => */filter/tips/
                    [21] => */logout/
                    [22] => */node/add/
                    [23] => */search/
                    [24] => */user/register/
                    [25] => */user/password/
                    [26] => */user/login/
                    [27] => */?q=admin/
                    [28] => */?q=comment/reply/
                    [29] => */?q=filter/tips/
                    [30] => */?q=logout/
                    [31] => */?q=node/add/
                    [32] => */?q=search/
                    [33] => */?q=user/password/
                    [34] => */?q=user/register/
                    [35] => */?q=user/login/
                    [36] => /&*
                    [37] => /feedback/
                    [38] => */page-*/
                    [39] => /node/*
                    [40] => /*/node/
                    [41] => */embed/*
                    [42] => /*/fp_admin_preview-
                    [43] => /taxonomy/term/
                    [44] => /*/taxonomy/term/
                    [45] => /category/
                    [46] => /*/category/
                    [47] => /core/
                    [48] => /README.txt
                    [49] => /web.config
                    [50] => /admin/
                    [51] => /comment/reply/
                    [52] => */window_of_opportunities
                    [53] => *?aff
                    [54] => *?nw
                    [55] => *?from
                    [56] => *?icid
                    [57] => *?param
                )

            [sitemap] => Array
                (
                    [0] => https://www.fxclub.org/sitemap.xml
                )

        )

)
User-agent: *
Allow: /misc/*.js
Allow: /misc/*.css
Allow: /misc/*.png
Allow: /misc/*.svg
Allow: /misc/*.jpg
Allow: /sites/*.js
Allow: /sites/*.css
Allow: /sites/*.png
Allow: /sites/*.svg
Allow: /sites/*.jpg
Disallow: */language
Disallow: */includes/
Disallow: */misc/
Disallow: */modules/
Disallow: */profiles/
Disallow: */scripts/
Disallow: */themes/
Disallow: */CHANGELOG.txt
Disallow: */cron.php
Disallow: */INSTALL.mysql.txt
Disallow: */INSTALL.pgsql.txt
Disallow: */install.php
Disallow: */INSTALL.txt
Disallow: */LICENSE.txt
Disallow: */MAINTAINERS.txt
Disallow: */update.php
Disallow: */UPGRADE.txt
Disallow: */xmlrpc.php
Disallow: */admin/
Disallow: */comment/reply/
Disallow: */filter/tips/
Disallow: */logout/
Disallow: */node/add/
Disallow: */search/
Disallow: */user/register/
Disallow: */user/password/
Disallow: */user/login/
Disallow: */?q=admin/
Disallow: */?q=comment/reply/
Disallow: */?q=filter/tips/
Disallow: */?q=logout/
Disallow: */?q=node/add/
Disallow: */?q=search/
Disallow: */?q=user/password/
Disallow: */?q=user/register/
Disallow: */?q=user/login/
Disallow: /&*
Disallow: /feedback/
Disallow: */page-*/
Disallow: /node/*
Disallow: /*/node/
Disallow: */embed/*
Disallow: /*/fp_admin_preview-
Disallow: /taxonomy/term/
Disallow: /*/taxonomy/term/
Disallow: /category/
Disallow: /*/category/
Disallow: /core/
Disallow: /README.txt
Disallow: /web.config
Disallow: /admin/
Disallow: /comment/reply/
Disallow: */window_of_opportunities
Disallow: *?aff
Disallow: *?nw
Disallow: *?from
Disallow: *?icid
Disallow: *?param

Sitemap: https://www.fxclub.org/sitemap.xml
  • код 301 http://fxclub.org/robots.txt
  • код 301 https://fxclub.org/robots.txt
  • код 200 https://www.fxclub.org/robots.txt