Kwork.ru has robots.txt file. Http response code is 200.
Robots size is very small. It is about 53 kb and 20 rows.

kwork.ru has sitemap file https://kwork.ru/sitemap.xml. Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain kwork.ru in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /files/uploaded
                    [1] => /files/uploaded2
                    [2] => /administrator
                    [3] => /*?s=
                    [4] => /*&s=
                    [5] => /?&page=
                    [6] => /*?page=
                    [7] => /*&page=
                    [8] => /login
                    [9] => /signup
                    [10] => /forgotpassword
                    [11] => /search
                    [12] => /track
                    [13] => /inbox
                    [14] => /conversations
                    [15] => /portfolio
                    [16] => /cases/
                )

            [clean-param] => Array
                (
                    [0] => attribute_id
                )

            [sitemap] => Array
                (
                    [0] => https://kwork.ru/sitemap.xml
                )

        )

)
User-agent: *
Disallow: /files/uploaded
Disallow: /files/uploaded2
Disallow: /administrator
Disallow: /*?s=
Disallow: /*&s=
Disallow: /?&page=
Disallow: /*?page=
Disallow: /*&page=
Disallow: /login
Disallow: /signup
Disallow: /forgotpassword
Disallow: /search
Disallow: /track
Disallow: /inbox
Disallow: /conversations
Disallow: /portfolio
Disallow: /cases/
Clean-param: attribute_id
Sitemap: https://kwork.ru/sitemap.xml
  • код 301 http://kwork.ru/robots.txt
  • код 200 https://kwork.ru/robots.txt