Re: [squid-users] Re: ubuntu apt-get update 404

Amos Jeffries wrote:
> Michael Bowe wrote:
>>> -----Original Message-----
>>> From: Matthew Morgan [mailto:atcs.matthew_at_gmail.com]
>>> Sent: Saturday, 14 November 2009 7:59 AM
>>> To: Squid Users
>>> Subject: Re: [squid-users] Re: ubuntu apt-get update 404
>>>
>>
>>> Apparently I only get the dropped .bz2 extensions when using squid
>>> transparently, which is how our network is set up. If I manually
>>> specify http_proxy on my workstation to point to squid directly, I
>>> don't
>>> have any problems with apt-get update. Has anyone ever heard of this?
>>> Here's my updated squid config (this is 3.0-STABLE20, btw).
>>
>> I've been having perhaps related problems with Debian servers behind
>> Squid
>> 3.1.0.14 TPROXY
>>
>> I am not getting 404's but am intermittently seeing "invalid reply
>> header"
>> errors. eg :
>>
>> Failed to fetch
>> http://backports.org/debian/dists/etch-backports/main/binary-amd64/Packages.
>>
>> gz The HTTP server sent an invalid reply header
>>
>> Err http://security.debian.org lenny/updates Release.gpg
>> The HTTP server sent an invalid reply header [IP: 150.203.164.38 80]
>>
>> W: Failed to fetch
>> http://security.debian.org/dists/lenny/updates/Release.gpg The HTTP
>> server
>> sent an invalid reply header [IP: 150.203.164.38 80]
>>
>> As you say, if I specify HTTP_PROXY= to go direct to the cache rather
>> than
>> transparent then all works fine
>>
>> Michael.
>>
>
> I wonder. Is that actually 3.1.0.14 direct to origin? or perhapse
> going through some older sub-cache?
>
> Are the two of you able to provide me with "tcpdump -s0" traces of the
> data between apt and squid please? particularly for the transparent
> mode problems.
>
> Amos
Ok, it seems to happen in stages. The first time I run apt-get update
after switching to 3.x, it's hit or miss. Sometimes it's perfect,
sometimes I get errors. After that, I get errors in two stages. Here's
what happens:

Either:

apt-get update #1 - no errors
apt-get update #2 - invalid header, and sometimes 404 errors
apt-get update #3 and above - 404 errors only

or:

apt-get update #1 - invalid header, and sometimes 404 errors
apt-get update #2 and above - 404 errors only

The dump files I have uploaded match the second set of circumstances.
server1.dump and client1.dump are from the first apt-get update after
switching, and I got an invalid header error + 404 errors. server2.dump
and client2.dump came from the second apt-get update attempt, and only
404 errors were returned.

I hope this helps! Let me know if you need anything else. Just a
reminder, on my setup I only have 1 squid server with 1 cache
directory. For comparison, my server is Ubuntu 9.04 running kernel
2.6.28-16-server. I am not using TPROXY.

Here are the files (I tried to attach them, but mailer-daemon kicked the
email)

http://lithagen.dyndns.org/server1.dump
http://lithagen.dyndns.org/client1.dump
http://lithagen.dyndns.org/server2.dump
http://lithagen.dyndns.org/client2.dump
Received on Mon Nov 16 2009 - 23:05:56 MST