[Web] Restrictive robots.txt file

[David Boddie]

On Wednesday 12. October 2016, Tero Kojo wrote:
> 
> The qt-project.org server has been offline for quite a while now.
> Right now the domain is used only as a redirect server with no content
> whatsoever.
> 
> Apparently the robots file was there in 2013. We can't change that.

That's true but my understanding, which may be wrong, is that a robots.txt
file currently in place will cause archive.org to withhold pages that were
previously available:

https://archive.org/about/faqs.php#14

> I can ask if we have a dump of the server somewhere on tape.

Thanks! If the internal Git repositories (hosted on an internal Gitorious
instance) still exist, it should be possible to regenerate the Qt Quarterly
site almost completely. For the issues that were hosted on the Qt Developer
Network, Nokia or Digia sites, it should be possible to recreate the articles
themselves even if the overview pages are missing.

David