[Qt-interest] How to design a "search and download" application in Qt with multiple threads in mind.

Martin Hofius Martin at hofius-online.com
Mon Sep 13 08:07:33 CEST 2010


Am Sonntag, 12. September 2010 schrieb Andre Somers:
>   Op 10-9-2010 17:24, Sven Grunewaldt schreef:
> > Hi, I'm currently trying to plan an application that scans multiple web
> > pages for images, puts them in a download queue and downloads these
> > images.
> >
> > I'm struggling with the design of the classes and such. My initial idea
> > was the following:
...
> downloaded by a webpage wherever you like. Also, you should probably
> ditch the idea of complicated queues and multiple threads. Using
> multiple threads will not increase your network speed, nor will it
> increase your disk IO speeds. *Those* will be your bottlenecks, not your
you can archive multiple parallel transmissions by using non blocking calls - 
without additional overhead for multiple threads. 
I also don't think that disk IO is a real limitation for web downloads - 
except you have a direkt connection to an internet backbone...

Even when many download accelerator programs use parallel transmissions to 
increase download speed (to circumvent limitations of the server or to use 
more than one server of a server farm) - please think about fair use of the 
server and network capacities...

Martin



More information about the Qt-interest-old mailing list