[squid-users] Consider increasing the number of url_rewriter processes / All url_rewriter processes are busy

Hello,

A squid box we recently upgraded to use Websense 7.1 has intermitent issues. See the log below..
<SNIP>

Dec 28 10:03:00 dss-so92la05 squid[26940]: Starting Squid Cache version 2.7.STABLE6 for i686-pc-linux-gnu...
Dec 28 10:03:00 dss-so92la05 squid[26940]: Process ID 26940
Dec 28 10:03:00 dss-so92la05 squid[26940]: With 4096 file descriptors available
Dec 28 10:03:00 dss-so92la05 squid[26940]: Using epoll for the IO loop
Dec 28 10:03:00 dss-so92la05 squid[26940]: DNS Socket created at 0.0.0.0, port 33381, FD 6
Dec 28 10:03:00 dss-so92la05 squid[26940]: Adding nameserver 10.120.11.85 from /etc/resolv.conf
Dec 28 10:03:00 dss-so92la05 squid[26940]: Adding nameserver 10.120.11.107 from /etc/resolv.conf
Dec 28 10:03:00 dss-so92la05 squid[26940]: Adding domain dss.la.gov from /etc/resolv.conf
Dec 28 10:03:00 dss-so92la05 squid[26940]: helperOpenServers: Starting 30 'WsRedtor' processes
Dec 28 10:03:00 dss-so92la05 squid[26940]: logfileOpen: opening log /var/log/squid/access.log
Dec 28 10:03:01 dss-so92la05 squid[26940]: Unlinkd pipe opened on FD 41
Dec 28 10:03:01 dss-so92la05 squid[26940]: Swap maxSize 16384000 + 262144 KB, estimated 0 objects
Dec 28 10:03:01 dss-so92la05 squid[26940]: Target number of buckets: 64023
Dec 28 10:03:01 dss-so92la05 squid[26940]: Using 65536 Store buckets
Dec 28 10:03:01 dss-so92la05 squid[26940]: Max Mem size: 262144 KB
Dec 28 10:03:01 dss-so92la05 squid[26940]: Max Swap size: 16384000 KB
Dec 28 10:03:01 dss-so92la05 squid[26940]: Store logging disabled
Dec 28 10:03:01 dss-so92la05 squid[26940]: Rebuilding storage in /apps/squid/cache1 (CLEAN)
Dec 28 10:03:01 dss-so92la05 squid[26940]: Rebuilding storage in /apps/squid/cache2 (CLEAN)
Dec 28 10:03:01 dss-so92la05 squid[26940]: Rebuilding storage in /apps/squid/cache3 (CLEAN)
Dec 28 10:03:01 dss-so92la05 squid[26940]: Rebuilding storage in /apps/squid/cache4 (CLEAN)
Dec 28 10:03:01 dss-so92la05 squid[26940]: Using Least Load store dir selection
Dec 28 10:03:01 dss-so92la05 squid[26940]: Current Directory is /
Dec 28 10:03:01 dss-so92la05 squid[26940]: Loaded Icons.
Dec 28 10:03:01 dss-so92la05 squid[26940]: Accepting proxy HTTP connections at 10.120.100.205, port 8080, FD 48.
Dec 28 10:03:01 dss-so92la05 squid[26940]: Accepting ICP messages at 0.0.0.0, port 3130, FD 49.
Dec 28 10:03:01 dss-so92la05 squid[26940]: WCCP Disabled.
Dec 28 10:03:01 dss-so92la05 squid[26940]: Configuring 10.120.9.80 Parent 10.120.9.80/8080/3130
Dec 28 10:03:01 dss-so92la05 squid[26940]: Configuring 10.120.9.100 Parent 10.120.9.100/8080/3130
Dec 28 10:03:01 dss-so92la05 squid[26940]: Ready to serve requests.
Dec 28 10:03:01 dss-so92la05 squid[26940]: Store rebuilding is 27.8% complete
Dec 28 10:03:01 dss-so92la05 squid[26940]: Done reading /apps/squid/cache4 swaplog (13075 entries)
Dec 28 10:03:01 dss-so92la05 squid[26940]: Done reading /apps/squid/cache1 swaplog (14731 entries)
Dec 28 10:03:01 dss-so92la05 squid[26940]: Done reading /apps/squid/cache3 swaplog (14779 entries)
Dec 28 10:03:01 dss-so92la05 squid[26940]: Done reading /apps/squid/cache2 swaplog (15337 entries)
Dec 28 10:03:01 dss-so92la05 squid[26940]: Finished rebuilding storage from disk.
Dec 28 10:03:01 dss-so92la05 squid[26940]: 57922 Entries scanned
Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Invalid entries.
Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 With invalid flags.
Dec 28 10:03:01 dss-so92la05 squid[26940]: 57922 Objects loaded.
Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Objects expired.
Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Objects cancelled.
Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Duplicate URLs purged.
Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Swapfile clashes avoided.
Dec 28 10:03:01 dss-so92la05 squid[26940]: Took 0.5 seconds (121961.6 objects/sec).
Dec 28 10:03:01 dss-so92la05 squid[26940]: Beginning Validation Procedure
Dec 28 10:03:01 dss-so92la05 squid[26940]: Completed Validation Procedure
Dec 28 10:03:01 dss-so92la05 squid[26940]: Validated 57922 Entries
Dec 28 10:03:01 dss-so92la05 squid[26940]: store_swap_size = 929412k
Dec 28 10:03:01 dss-so92la05 squid[26940]: WARNING: All url_rewriter processes are busy.
Dec 28 10:03:01 dss-so92la05 squid[26940]: WARNING: up to 30 pending requests queued
Dec 28 10:03:01 dss-so92la05 squid[26940]: storeLateRelease: released 0 objects
Dec 28 10:03:31 dss-so92la05 squid[26940]: WARNING: All url_rewriter processes are busy.
Dec 28 10:03:31 dss-so92la05 squid[26940]: WARNING: up to 154 pending requests queued
Dec 28 10:03:31 dss-so92la05 squid[26940]: storeDirWriteCleanLogs: Starting...
Dec 28 10:03:31 dss-so92la05 squid[26940]: WARNING: Closing open FD 48
Dec 28 10:03:31 dss-so92la05 squid[26940]: commSetEvents: epoll_ctl(EPOLL_CTL_DEL): failed on fd=48: (1) Operation not permitted
Dec 28 10:03:31 dss-so92la05 squid[26940]: WARNING: Closing open FD 49
Dec 28 10:03:31 dss-so92la05 squid[26940]: commSetEvents: epoll_ctl(EPOLL_CTL_DEL): failed on fd=49: (1) Operation not permitted
Dec 28 10:03:31 dss-so92la05 squid[26940]: Finished. Wrote 57925 entries.
Dec 28 10:03:31 dss-so92la05 squid[26940]: Took 0.0 seconds (4941141.3 entries/sec).
Dec 28 10:03:31 dss-so92la05 squid[26940]: Too many queued url_rewriter requests (154 on 30)
Dec 28 10:03:31 dss-so92la05 squid[10675]: Squid Parent: child process 26940 exited due to signal 6
Dec 28 10:03:34 dss-so92la05 squid[10675]: Squid Parent: child process 27240 started
Dec 28 10:03:34 dss-so92la05 squid[27240]: Starting Squid Cache version 2.7.STABLE6 for i686-pc-linux-gnu...
Dec 28 10:03:34 dss-so92la05 squid[27240]: Process ID 27240
Dec 28 10:03:34 dss-so92la05 squid[27240]: With 4096 file descriptors available
Dec 28 10:03:34 dss-so92la05 squid[27240]: Using epoll for the IO loop
Dec 28 10:03:34 dss-so92la05 squid[27240]: DNS Socket created at 0.0.0.0, port 33382, FD 6
Dec 28 10:03:34 dss-so92la05 squid[27240]: Adding nameserver 10.120.11.85 from /etc/resolv.conf
Dec 28 10:03:34 dss-so92la05 squid[27240]: Adding nameserver 10.120.11.107 from /etc/resolv.conf
Dec 28 10:03:34 dss-so92la05 squid[27240]: Adding domain dss.la.gov from /etc/resolv.conf
Dec 28 10:03:34 dss-so92la05 squid[27240]: helperOpenServers: Starting 30 'WsRedtor' processes
Dec 28 10:03:35 dss-so92la05 squid[27240]: logfileOpen: opening log /var/log/squid/access.log
Dec 28 10:03:35 dss-so92la05 squid[27240]: Unlinkd pipe opened on FD 41
Dec 28 10:03:35 dss-so92la05 squid[27240]: Swap maxSize 16384000 + 262144 KB, estimated 0 objects
Dec 28 10:03:35 dss-so92la05 squid[27240]: Target number of buckets: 64023
Dec 28 10:03:35 dss-so92la05 squid[27240]: Using 65536 Store buckets
Dec 28 10:03:35 dss-so92la05 squid[27240]: Max Mem size: 262144 KB
Dec 28 10:03:35 dss-so92la05 squid[27240]: Max Swap size: 16384000 KB
Dec 28 10:03:35 dss-so92la05 squid[27240]: Store logging disabled
Dec 28 10:03:35 dss-so92la05 squid[27240]: Rebuilding storage in /apps/squid/cache1 (CLEAN)
Dec 28 10:03:35 dss-so92la05 squid[27240]: Rebuilding storage in /apps/squid/cache2 (CLEAN)
Dec 28 10:03:35 dss-so92la05 squid[27240]: Rebuilding storage in /apps/squid/cache3 (CLEAN)
Dec 28 10:03:35 dss-so92la05 squid[27240]: Rebuilding storage in /apps/squid/cache4 (CLEAN)
Dec 28 10:03:35 dss-so92la05 squid[27240]: Using Least Load store dir selection
Dec 28 10:03:35 dss-so92la05 squid[27240]: Current Directory is /
Dec 28 10:03:35 dss-so92la05 squid[27240]: Loaded Icons.
Dec 28 10:03:35 dss-so92la05 squid[27240]: Accepting proxy HTTP connections at 10.120.100.205, port 8080, FD 48.
Dec 28 10:03:35 dss-so92la05 squid[27240]: Accepting ICP messages at 0.0.0.0, port 3130, FD 49.
Dec 28 10:03:35 dss-so92la05 squid[27240]: WCCP Disabled.
Dec 28 10:03:35 dss-so92la05 squid[27240]: Configuring 10.120.9.80 Parent 10.120.9.80/8080/3130
Dec 28 10:03:35 dss-so92la05 squid[27240]: Configuring 10.120.9.100 Parent 10.120.9.100/8080/3130
Dec 28 10:03:35 dss-so92la05 squid[27240]: Ready to serve requests.
Dec 28 10:03:35 dss-so92la05 squid[27240]: Store rebuilding is 27.8% complete
Dec 28 10:03:35 dss-so92la05 squid[27240]: Done reading /apps/squid/cache4 swaplog (13074 entries)
Dec 28 10:03:35 dss-so92la05 squid[27240]: Done reading /apps/squid/cache1 swaplog (14730 entries)
Dec 28 10:03:35 dss-so92la05 squid[27240]: Done reading /apps/squid/cache3 swaplog (14782 entries)
Dec 28 10:03:35 dss-so92la05 squid[27240]: Done reading /apps/squid/cache2 swaplog (15339 entries)
Dec 28 10:03:35 dss-so92la05 squid[27240]: Finished rebuilding storage from disk.
Dec 28 10:03:35 dss-so92la05 squid[27240]: 57925 Entries scanned
Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Invalid entries.
Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 With invalid flags.
Dec 28 10:03:35 dss-so92la05 squid[27240]: 57925 Objects loaded.
Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Objects expired.
Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Objects cancelled.
Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Duplicate URLs purged.
Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Swapfile clashes avoided.
Dec 28 10:03:35 dss-so92la05 squid[27240]: Took 0.5 seconds (123329.2 objects/sec).
Dec 28 10:03:35 dss-so92la05 squid[27240]: Beginning Validation Procedure
Dec 28 10:03:35 dss-so92la05 squid[27240]: Completed Validation Procedure
Dec 28 10:03:35 dss-so92la05 squid[27240]: Validated 57925 Entries
Dec 28 10:03:35 dss-so92la05 squid[27240]: store_swap_size = 929424k
Dec 28 10:03:36 dss-so92la05 squid[27240]: storeLateRelease: released 0 objects Dec 28 10:03:36 dss-so92la05 squid[27240]: WARNING: All url_rewriter processes are busy.
Dec 28 10:03:36 dss-so92la05 squid[27240]: WARNING: up to 30 pending requests queued Dec 28 10:04:07 dss-so92la05 squid[27240]: WARNING: All url_rewriter processes are busy.
Dec 28 10:04:07 dss-so92la05 squid[27240]: WARNING: up to 207 pending requests queued Dec 28 10:04:07 dss-so92la05 squid[27240]: Consider increasing the number of url_rewriter processes to at least 237 in your config file.

--
Below is the sys info:
dss-so92la05:~ # uname -a
Linux dss-so92la05 2.6.16.60-0.42.5-bigsmp #1 SMP Mon Aug 24 09:41:41 UTC 2009 i686 i686 i386 GNU/Linux dss-so92la05:~ # rpm -qa | grep squid
squid-2.7.STABLE6-1
--
From squid.conf
url_rewrite_children 60
url_rewrite_program /opt/Websense/bin/WsRedtor
---
So, do I just change the rewriters to 237?  Will that harm anything else?
Thanks..