[squid-users] Re: RPM for Squid 3.3.10 is OUT.

Eliezer Croitoru-2 wrote
> I am happy to release the new RPM for squid version 3.3.10.(links at the
> bottom of the article)
>
> The new release includes the big addition of cache_dir type *rock*, big
> thanks for Alex Rousskov work on rock ssl-bump and many other small and
> big things that makes squid what it is!
>
> What is *rock* cache_dir type? What it gives me?
> Speed! and SMP support for cache_dir.
>
> A small introduction to FileSystems and Squid:
> Squid uses UFS\AUFS types cache directories for a very long time in a
> very nice way to overcome and try to beat the OS and the FileSystems
> limits in order to allow millions of objects\files to be cached.
>
> The UFS type that can be used with either reiserFS, ext4 or any other FS
> you can think about that is supported by the OS.
> There are limits to each and every FS like the reiserFS that was
> designed to work with lots of small\tiny files and does that in a very
> nice way.
>
> A FS far as it is perfected it is still a *FileSystem* which is very
> global and has a design which effects directly on the performance of
> itself.
> An example for this point is being demonstrated when creating a file on
> a FS can be quite easy in one while erasing a file can result in a very
> CPU and I\O intensive task on some FS.
> If you are interested in understanding a bit more about FS complexity
> you can watch Ric Wheeler at his video and presentation:
> * video:
> http://video.linux.com/videos/one-billion-files-pushing-scalability-limits-of-linux-file-systems
> * or: http://www1.ngtech.co.il/squid/videos/37.webm
>
> * pdf:
> http://www.redhat.com/summit/2011/presentations/summit/decoding_the_code/thursday/wheeler_t_0310_billion_files_2011.pdf
> * or:
> http://www1.ngtech.co.il/squid/fs/wheeler_t_0310_billion_files_2011.pdf
>
>
> What heavy lifting do the FS and squid needs to handle with?
> UFS\AUFS actually uses the FileSystem in order to store for an example
> 200 requests per second which 50 of them are not even cacheable so 150
> requests per second to be placed in files in the FileSystem based on the
> OS.
> 60 secs doubles 60 minutes doubles 100 requests per second(yes I reduced
> it..) it means creation of about 3600 files on the FS per hour for a
> tiny Small Office squid instance.
> While some squid systems can sit on a very big machine with more then
> one instance that has more then 500 requests per second per instance,
> the growth can be about 14,400,000 per hour.
>
> It do sounds like a very big number but a MegaByte is about 1 Million
> bytes and today we are talking about speeds which exceeds 10Gbps..
>
> So there might be another design that is needed in order to store all
> these HTTP objects and which rock comes to unleash.
>
> In the next release I will try to describe it in more depth.
>
> * note that the examples do demonstrate the ideas in a wild way.
>
> The RPMS at:
> http://www1.ngtech.co.il/rpm/centos/6/x86_64/
>
> The package includes 3 RPMs one for the squid core and helpers, the
> other is for debuging and the third is the init script.
> http://www1.ngtech.co.il/rpm/centos/6/x86_64/squid-3.3.10-1.el6.x86_64.rpm
> http://www1.ngtech.co.il/rpm/centos/6/x86_64/squid-sysvinit-3.3.10-1.el6.x86_64.rpm
> http://www1.ngtech.co.il/rpm/centos/6/x86_64/squid-debuginfo-3.3.10-1.el6.x86_64.rpm
>
> To Each and everyone of them there is an asc file which contains PGP and
> MD5 SHA1 SHA2 SHA256 SHA384 SHA512 hashes.
>
> I also released the SRPM which is very simple at:
> http://www1.ngtech.co.il/rpm/centos/6/x86_64/SRPM/squid-3.3.10-1.el6.src.rpm
>
> * I do hope to release in the next weeks a RPM of 3.HEAD build for ALPHA
> testers of the newest bug fixes and squid improvements.
>
> * Sorry that the I686 release is not out yet but since I do not have on
> me a I686 running OS it will be added later to the repo.
>
> Eliezer

nice news ,
i would like to ask about mounting options related to rock ,
is it critical for performance ??
' i read wiki , but no one care with it !!!

as an example machine with 7 hardisks ssd , each hardisk with 90 G storage ,
and with about 4000 req/sec on squid with smp.

does squid 3.3.10 better than squid 3.3.9 for rock support and speed ???
if not big updater i prefer staying with 3.3.9

regards

-----
Dr.x

--
View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/Squid-3-3-10-is-available-tp4663209p4663229.html
Sent from the Squid - Users mailing list archive at Nabble.com.