RE: [squid-users] Big file http downloads crash...

goto:
http://www.sun.com/software/solaris/binaries/download.html

at the bottom, click on Solaris8 4/01 Download,
you must have/create a Sun Software account; then
download one or two of the CD's. Before trying it again this
morning, RSS of squid was 95MB, once it had downloaded 100MB of the CD,
RSS started growing in exact proportion to the size of the CD, and CPU
usage is now up to 15%, up from 0.5%, after downloading only 150MB.

truss -p shows a bunch of:
gettimeofday
msgsys....ERR#83'No message of desired type'
poll
read
gettimeofday
...

lsof gives no obvious hints, vmstat -m is not obvious,
systat -vmstat shows the cache disk is 30-50% busy, which
is 30-50% more busy than it usualy is... hmmm...
namei calls are up to around 12000/sec, but with 92% hits.
The Download speed of this file is around 90-100KB/sec.

killing the download from the client side brings all this
activity to a halt, but squid keeps the big RSS.
The machine is: P3-800 512MB of ram and a single cache disk
other than the system disk.

Is this happening to anyone else? (maybe it is specific to how
Sun round-robins and virtual-hosts its download sites...)
-Rob

-----Original Message-----
From: Henrik Nordstrom [mailto:hno@hem.passagen.se]
Sent: Wednesday, June 06, 2001 11:24 PM
To: Rob Mallory
Cc: 'squid-users@squid-cache.org'
Subject: Re: [squid-users] Big file http downloads crash...

Rob Mallory wrote:
>
> > I'm downloading big CD images through my squid caches, via a HTTP
get,
> > and am noticing that the RSS of the process grows as the download
> > procedes... the CPU usage goes up also as the download continues...
> >
> > I'm running FreeBSD, diskd, LFUDA, and have seen the same behavior on
2.4
> > and 2.5-devel branches...

It is not supposed to.

Do you have any URL where this happens?

--
Henrik Nordstrom
Squid Hacker