[Development] Search engine indexing of qt-project.org
dangelog at gmail.com
Tue Jun 11 17:30:28 CEST 2013
CCing web at qt-project.org...
On 11 June 2013 17:13, Robin Burchell <robin+qt at viroteck.net> wrote:
> I've noticed that the quality of search results for Qt documentation
> (and so forth) in search engines has been terrible. I just noticed
> that they now seem to be hosted directly on http://qt-project.org,
> which has a robots.txt with the following gem:
> User-agent: *
> Disallow: /
Really? I get a much more complete robots, which disallows only certain parts...
> This seems ... very counterproductive. It certainly explains the bad
> results. Can someone please comment why this is so, if this is
> correct, or forward it to the right people to get it fixed please?
Amongst other things, this is still open (together with its
suggestions to improve ranking, which unless implemented can't be
$ GET http://qt-project.org/robots.txt
# Start Qt Developer Network file for metal spiders
# Skip the following:
# Allow Google to crawl our general images
# End robots.txt file
More information about the Development