Eurofirms.es has robots.txt file. Http response code is 200.
Robots size is very small. It is about 43 kb and 11 rows.

Host directive is not presented for domain eurofirms.es in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /Treballadors/
                    [1] => /AreaPrivada/Clients/
                    [2] => /AreaPrivada/Treballadors/
                    [3] => /Clients/
                )

            [allow] => Array
                (
                    [0] => /AreaPrivada/Treballadors/Register/CheckDNI
                    [1] => /Treballadors/Register/CheckDNI
                )

        )

)
User-agent: *
#Sitemap: https://secure.eurofirms.es/sitemap.xml
# Evitar accedir a la area privada
Disallow: /Treballadors/
Disallow: /AreaPrivada/Clients/
Disallow: /AreaPrivada/Treballadors/
Disallow: /Clients/

# poder rastrejar nou candidat
Allow: /AreaPrivada/Treballadors/Register/CheckDNI
Allow: /Treballadors/Register/CheckDNI
  • код 301 http://eurofirms.es/robots.txt
  • код 200 https://eurofirms.es/robots.txt