[FUG-BR] Squid: COSS funciona?
Joao Rocha Braga Filho
goffredo em gmail.com
Quarta Novembro 26 11:27:08 BRST 2008
Pelo que eu entendi, o coss só é mesmo bom para objetos pequenos.
Então eu dividi o cache em AUFS (e pretendia testar o diskd depois)
para objetos grandes, e COSS para pequenos. Mas não consigo fazer
o COSS funcionar direito.
As opções de compilação que eu usei são:
===> The following configuration options are available for squid-2.7.5:
SQUID_LDAP_AUTH=off "Install LDAP authentication helpers"
SQUID_SASL_AUTH=off "Install SASL authentication helpers"
SQUID_DELAY_POOLS=off "Enable delay pools"
SQUID_SNMP=off "Enable SNMP support"
SQUID_CARP=on "Enable CARP support"
SQUID_SSL=on "Enable SSL support for reverse proxies"
SQUID_PINGER=off "Install the icmp helper"
SQUID_DNS_HELPER=off "Use the old 'dnsserver' helper"
SQUID_HTCP=off "Enable HTCP support"
SQUID_VIA_DB=off "Enable forward/via database"
SQUID_CACHE_DIGESTS=off "Enable cache digests"
SQUID_WCCP=on "Enable Web Cache Coordination Prot. v1"
SQUID_WCCPV2=off "Enable Web Cache Coordination Prot. v2"
SQUID_STRICT_HTTP=off "Be strictly HTTP compliant"
SQUID_IDENT=on "Enable ident (RFC 931) lookups"
SQUID_REFERER_LOG=off "Enable Referer-header logging"
SQUID_USERAGENT_LOG=off "Enable User-Agent-header logging"
SQUID_ARP_ACL=off "Enable ACLs based on ethernet address"
SQUID_PF=off "Enable transparent proxying with PF"
SQUID_IPFILTER=off "Enable transp. proxying with IPFilter"
SQUID_FOLLOW_XFF=off "Follow X-Forwarded-For headers"
SQUID_AUFS=on "Enable the aufs storage scheme"
SQUID_COSS=on "Enable the COSS storage scheme"
SQUID_KQUEUE=on "Use kqueue(2) instead of poll(2)"
SQUID_LARGEFILE=on "Support log and cache files >2GB"
SQUID_STACKTRACES=off "Create backtraces on fatal errors"
===> Use 'make config' to modify these settings
João Rocha.
On Wed, Nov 26, 2008 at 11:19 AM, William David FUG-BR
<fugbr at biosystems.ath.cx> wrote:
> completando
>
> Estive fazendo testes com o Vmware esxi criei 2 maquinas virtuais
> freebsd 7.0p5 ambas com a mesma imagem
> rodando simultaneamente uma com squid + coss e outra com squid+ diskd
>
> configurei um terceiro squid fora da vmware como cahce_null e
> rodando parent para estas 2 maquinas :
> apontei 150 computadores da rede para este proxy que divide as
> requisições entre os 2 outros proxy na vmware
>
> ______________________________________________________________
> HTTP/1.0 200 OK
> Server: squid/2.7.STABLE4
> Date: Wed, 26 Nov 2008 13:20:08 GMT
> Content-Type: text/plain
> Expires: Wed, 26 Nov 2008 13:20:08 GMT
> X-Cache: MISS from kurohitsugi.hinodeinfo.com.br
> X-Cache-Lookup: MISS from kurohitsugi.hinodeinfo.com.br:3128
> Via: 1.0 kurohitsugi.hinodeinfo.com.br:3128 (squid/2.7.STABLE4)
> Connection: close
>
> Hostname Hash Multiplier Factor Actual
> 192.168.1.225 ad0066b0 1.000000 0.500000 0.636751
> 192.168.1.226 d9ccb113 1.000000 0.500000 0.363249
>
> _______________________________________________________________
> squid .2.7.5 + coss
> HTTP/1.0 200 OK
> Server: squid/2.7.STABLE5
> Date: Wed, 26 Nov 2008 15:15:33 GMT
> Content-Type: text/plain
> Expires: Wed, 26 Nov 2008 15:15:33 GMT
> X-Cache: MISS from alforja-001a.alforja ( 192.168.1.225 )
> X-Cache-Lookup: MISS from alforja-001a.alforja:3128
> Via: 1.0 alforja-001a.alforja:3128 (squid/2.7.STABLE5)
> Connection: close
>
> Squid Object Cache: Version 2.7.STABLE5
> Start Time: Tue, 25 Nov 2008 14:16:49 GMT
> Current Time: Wed, 26 Nov 2008 15:26:33 GMT
> Connection information for squid:
> Number of clients accessing cache: 3
> Number of HTTP requests received: 15663
> Number of ICP messages received: 37419
> Number of ICP messages sent: 37424
> Number of queued ICP replies: 0
> Request failure ratio: 0.00
> Average HTTP requests per minute since start: 10.4
> Average ICP messages per minute since start: 49.6
> Select loop called: 6836612 times, 13.250 ms avg
> Cache information for squid:
> Request Hit Ratios: 5min: 1.5%, 60min: 3.1%
> Byte Hit Ratios: 5min: 3.9%, 60min: 1.8%
> Request Memory Hit Ratios: 5min: 66.7%, 60min: 61.0%
> Request Disk Hit Ratios: 5min: 0.0%, 60min: 0.0%
> Storage Swap size: 40558 KB
> Storage Mem size: 5644 KB
> Mean Object Size: 10.91 KB
> Requests given to unlinkd: 0
> Median Service Times (seconds) 5 min 60 min:
> HTTP Requests (All): 0.27332 0.33943
> Cache Misses: 0.27332 0.33943
> Cache Hits: 0.00286 0.00307
> Near Hits: 0.00000 0.23230
> Not-Modified Replies: 0.00000 0.00000
> DNS Lookups: 0.02447 0.15593
> ICP Queries: 0.00000 0.00000
> Resource usage for squid:
> UP Time: 90584.598 seconds
> CPU Time: 1059.093 seconds
> CPU Usage: 1.17%
> CPU Usage, 5 minute avg: 1.55%
> CPU Usage, 60 minute avg: 1.36%
> Process Data Segment Size via sbrk(): 806 KB
> Maximum Resident Size: 34544 KB
> Page faults with physical i/o: 2
> Memory accounted for:
> Total accounted: 12995 KB
> memPoolAlloc calls: 2715994
> memPoolFree calls: 2679295
> File descriptor usage for squid:
> Maximum number of file descriptors: 3520
> Largest file desc currently in use: 31
> Number of file desc currently in use: 24
> Files queued for open: 0
> Available number of file descriptors: 3496
> Reserved number of file descriptors: 100
> Store Disk files open: 0
> IO loop method: kqueue
> Internal Data Structures:
> 3874 StoreEntries
> 1137 StoreEntries with MemObjects
> 1136 Hot Object Cache Items
> 3719 on-disk objects
>
>
> COSS
> OPS SUCCESS FAIL
> open 183 183 0
> create 4041 4041 0
> close 4224 4224 0
> unlink 2566 2566 0
> read 643 136 0
> write 17184 17184 0
> s_write 44 44 0
>
> stripes: 4
> dead_stripes: 0
> alloc.alloc: 4041
> alloc.realloc: 30
> alloc.memalloc: 106
> alloc.collisions: 0
> disk_overflows: 0
> stripe_overflows: 44
> open_mem_hits: 47
> open_mem_misses: 136
>
> STOREDIR
>
> Store Directory Statistics:
> Store Entries : 3826
> Maximum Swap Size : 614400 KB
> Current Store Swap Size: 40388 KB
> Current Capacity : 7% used, 93% free
>
> Store Directory #0 (coss): /usr/local/squid/cache/coss00
> FS Block Size 512 Bytes
>
> Maximum Size: 307200 KB
> Current Size: 20243 KB
> Percent Used: 6.59%
> Current load metric: 0 / 1000
> Number of object collisions: 0
> Pending operations: 0 out of 128
> Flags:
> Pending Relocations: 0
> Stripe: 21, lockcount: 0, numobjects 91, flags:
> NOTFULL,NOTWRITING,NOTWRITTEN,DISK
> Stripe: 0, lockcount: 0, numobjects 41, flags:
> NOTFULL,NOTWRITING,NOTWRITTEN,MEMONLY
> Pending Relocations:
> Accepted object sizes: 0 - 1048576 bytes
>
> Store Directory #1 (coss): /usr/local/squid/cache/coss01
> FS Block Size 512 Bytes
>
> Maximum Size: 307200 KB
> Current Size: 20145 KB
> Percent Used: 6.56%
> Current load metric: 0 / 1000
> Number of object collisions: 0
> Pending operations: 0 out of 128
> Flags: SELECTED
> Pending Relocations: 0
> Stripe: 23, lockcount: 0, numobjects 66, flags:
> NOTFULL,NOTWRITING,NOTWRITTEN,DISK
> Stripe: 1, lockcount: 0, numobjects 44, flags:
> NOTFULL,NOTWRITING,NOTWRITTEN,MEMONLY
> Pending Relocations:
> Accepted object sizes: 0 - 1048576 bytes
>
> _______________________________________________________________
> HTTP/1.0 200 OK
> Server: squid/2.7.STABLE5
> Date: Wed, 26 Nov 2008 13:20:03 GMT
> Content-Type: text/plain
> Expires: Wed, 26 Nov 2008 13:20:03 GMT
> X-Cache: MISS from alforja-001b.alforja ( 192.168.1.226 )
> X-Cache-Lookup: MISS from alforja-001b.alforja:3128
> Via: 1.0 alforja-001b.alforja:3128 (squid/2.7.STABLE5)
> Connection: close
>
> Squid Object Cache: Version 2.7.STABLE5
> Start Time: Tue, 25 Nov 2008 10:43:32 GMT
> Current Time: Wed, 26 Nov 2008 13:20:03 GMT
> Connection information for squid:
> Number of clients accessing cache: 3
> Number of HTTP requests received: 11656
> Number of ICP messages received: 34652
> Number of ICP messages sent: 34652
> Number of queued ICP replies: 0
> Request failure ratio: 0.00
> Average HTTP requests per minute since start: 7.3
> Average ICP messages per minute since start: 43.4
> Select loop called: 6772446 times, 14.144 ms avg
> Cache information for squid:
> Request Hit Ratios: 5min: 1.9%, 60min: 5.1%
> Byte Hit Ratios: 5min: 3.5%, 60min: 4.3%
> Request Memory Hit Ratios: 5min: 100.0%, 60min: 66.7%
> Request Disk Hit Ratios: 5min: 0.0%, 60min: 5.6%
> Storage Swap size: 78588 KB
> Storage Mem size: 8184 KB
> Mean Object Size: 17.55 KB
> Requests given to unlinkd: 0
> Median Service Times (seconds) 5 min 60 min:
> HTTP Requests (All): 0.30459 0.37825
> Cache Misses: 0.30459 0.42149
> Cache Hits: 0.01387 0.01035
> Near Hits: 0.00000 0.12783
> Not-Modified Replies: 0.00000 0.00379
> DNS Lookups: 0.06364 0.02336
> ICP Queries: 0.00000 0.00000
> Resource usage for squid:
> UP Time: 95791.416 seconds
> CPU Time: 1983.186 seconds
> CPU Usage: 2.07%
> CPU Usage, 5 minute avg: 2.51%
> CPU Usage, 60 minute avg: 2.44%
> Process Data Segment Size via sbrk(): 840 KB
> Maximum Resident Size: 27292 KB
> Page faults with physical i/o: 9
> Memory accounted for:
> Total accounted: 10448 KB
> memPoolAlloc calls: 2637858
> memPoolFree calls: 2587884
> File descriptor usage for squid:
> Maximum number of file descriptors: 3520
> Largest file desc currently in use: 39
> Number of file desc currently in use: 34
> Files queued for open: 0
> Available number of file descriptors: 3486
> Reserved number of file descriptors: 100
> Store Disk files open: 0
> IO loop method: kqueue
> Internal Data Structures:
> 4569 StoreEntries
> 1718 StoreEntries with MemObjects
> 1717 Hot Object Cache Items
> 4477 on-disk objects
>
> DISKD
>
> sent_count: 22244
> recv_count: 22244
> max_away: 17
> max_shmuse: 17
> open_fail_queue_len: 0
> block_queue_len: 0
>
> OPS SUCCESS FAIL
> open 281 281 0
> create 3106 3106 0
> close 3387 3387 0
> unlink 808 808 0
> read 439 439 0
> write 14223 14223 0
>
> STOREDIR
>
> Store Directory #1 (diskd): /usr/local/squid/cache/b
> FS Block Size 2048 Bytes
> First level subdirectories: 4
> Second level subdirectories: 64
> Maximum Size: 307200 KB
> Current Size: 10906 KB
> Percent Used: 3.55%
> Current load metric: 100 / 1000
> Filemap bits in use: 813 of 16384 (5%)
> Filesystem Space in use: 3723562/9915034 KB (38%)
> Filesystem Inodes in use: 260819/1295358 (20%)
> Flags:
> Pending operations: 0
> Accepted object sizes: 0 - (unlimited) bytes
> Removal policy: heap
>
> Store Directory #2 (diskd): /usr/local/squid/cache/c
> FS Block Size 2048 Bytes
> First level subdirectories: 4
> Second level subdirectories: 64
> Maximum Size: 307200 KB
> Current Size: 14718 KB
> Percent Used: 4.79%
> Current load metric: 100 / 1000
> Filemap bits in use: 637 of 16384 (4%)
> Filesystem Space in use: 3723562/9915034 KB (38%)
> Filesystem Inodes in use: 260819/1295358 (20%)
> Flags:
> Pending operations: 0
> Accepted object sizes: 0 - (unlimited) bytes
> Removal policy: heap
>
> Store Directory #3 (diskd): /usr/local/squid/cache/d
> FS Block Size 2048 Bytes
> First level subdirectories: 4
> Second level subdirectories: 64
> Maximum Size: 307200 KB
> Current Size: 10646 KB
> Percent Used: 3.47%
> Current load metric: 100 / 1000
> Filemap bits in use: 716 of 16384 (4%)
> Filesystem Space in use: 3723562/9915034 KB (38%)
> Filesystem Inodes in use: 260819/1295358 (20%)
> Flags:
> Pending operations: 0
> Accepted object sizes: 0 - (unlimited) bytes
> Removal policy: heap
>
> Store Directory #4 (diskd): /usr/local/squid/cache/e
> FS Block Size 2048 Bytes
> First level subdirectories: 4
> Second level subdirectories: 64
> Maximum Size: 307200 KB
> Current Size: 10744 KB
> Percent Used: 3.50%
> Current load metric: 100 / 1000
> Filemap bits in use: 823 of 16384 (5%)
> Filesystem Space in use: 3723562/9915034 KB (38%)
> Filesystem Inodes in use: 260819/1295358 (20%)
> Flags:
> Pending operations: 0
> Accepted object sizes: 0 - (unlimited) bytes
> Removal policy: heap
>
> Store Directory #5 (diskd): /usr/local/squid/cache/f
> FS Block Size 2048 Bytes
> First level subdirectories: 4
> Second level subdirectories: 64
> Maximum Size: 307200 KB
> Current Size: 10626 KB
> Percent Used: 3.46%
> Current load metric: 100 / 1000
> Filemap bits in use: 601 of 16384 (4%)
> Filesystem Space in use: 3723562/9915034 KB (38%)
> Filesystem Inodes in use: 260819/1295358 (20%)
> Flags:
> Pending operations: 0
> Accepted object sizes: 0 - (unlimited) bytes
> Removal policy: heap
>
> Store Directory #6 (diskd): /usr/local/squid/cache/g
> FS Block Size 2048 Bytes
> First level subdirectories: 4
> Second level subdirectories: 64
> Maximum Size: 307200 KB
> Current Size: 10632 KB
> Percent Used: 3.46%
> Current load metric: 100 / 1000
> Filemap bits in use: 99 of 16384 (1%)
> Filesystem Space in use: 3723562/9915034 KB (38%)
> Filesystem Inodes in use: 260819/1295358 (20%)
> Flags:
> Pending operations: 0
> Accepted object sizes: 0 - (unlimited) bytes
> Removal policy: heap
>
>
>
> o coss atende mais requisições que o diskd mas em compensação salva
> menos cache que o diskd os 2 proxys eu inicializei juntos e
> zerados estas metragens são o conteudo de 3 dias de uso.
>
> --
> - = - = - = - = - = - = - = - = - = -
> <----. Of course it runs William David Armstrong
> <----|========================== Bio Systems Security Networking
> <----' FreeBSD MSN / GT biosystems gmail . com
> http://biosystems.ath.cx:8080/ http://biosystems.broker.freenet6.net/
> --------------------------------------
> -------------------------
> Histórico: http://www.fug.com.br/historico/html/freebsd/
> Sair da lista: https://www.fug.com.br/mailman/listinfo/freebsd
>
--
"Sempre se apanha mais com as menores besteiras. Experiência própria."
goffredo at gmail.com
Mais detalhes sobre a lista de discussão freebsd