Ptv.vic.gov.au has robots.txt file. Http response code is 200.
Robots size is very small. It is about 6 kb and 3 rows.

Robots.txt for User-Agent=* contains only disallow directives.

Host directive is not presented for domain ptv.vic.gov.au in robots.txt file.
Array
(
    [*] => Array
        (
            [disallow] => Array
                (
                    [0] => /lithe/
                )

            [crawl-delay] => 5
        )

)
User-agent: *
Disallow: /lithe/
Crawl-delay: 5
  • код 301 http://ptv.vic.gov.au/robots.txt
  • код 301 http://www.ptv.vic.gov.au/robots.txt
  • код 200 https://www.ptv.vic.gov.au/robots.txt