Performance testing

Fri Jul 22 17:41:29 CEST 2011

Hi all,

I'm starting to do a performance testing by sending a multipart mail
with an attachment with size between 100KB and 1MB,
but I'm getting a not good response time (~7 s from SA for 100KB
attachment) with only 1 email sent!

This is the extract of the amavisd log...

Jul 22 17:23:01 ffiore amavis[20757]: (20757-05) ESMTP:[127.0.0.1]:10024
/var/amavis/tmp/amavis-20110722T171321-20757: <ffiore at babel.it> ->
<ffiore at babel.it> SIZE=131900 BODY=8BITMIME Received: from
ffiore.localdomain ([127.0.0.1]) by localhost (ffiore.dhcp.babel.it
[127.0.0.1]) (amavisd-new, port 10024) with ESMTP for <ffiore at babel.it>;
Fri, 22 Jul 2011 17:23:01 +0200 (CEST)
Jul 22 17:23:01 ffiore amavis[20757]: (20757-05) Checking: r3y2FCViBjp5
[127.0.0.1] <ffiore at babel.it> -> <ffiore at babel.it>
Jul 22 17:23:01 ffiore amavis[20757]: (20757-05) p002 1 Content-Type:
multipart/mixed
Jul 22 17:23:01 ffiore amavis[20757]: (20757-05) p001 1/1 Content-Type:
text/plain, size: 130604 B, name: sed
Jul 22 17:23:08 ffiore amavis[20757]: (20757-05) FWD via SMTP:
<ffiore at babel.it> -> <ffiore at babel.it>,BODY=8BITMIME 250 2.0.0 Ok,
id=20757-05, from MTA([suse11.babel.it]:10025): 250 2.0.0 Ok: queued as
3F22720232F
Jul 22 17:23:08 ffiore amavis[20757]: (20757-05) Passed CLEAN,
[127.0.0.1] [127.0.0.1] <ffiore at babel.it> -> <ffiore at babel.it>,
Message-ID: <20110722152300.E90BA29C29 at ffiore.localdomain>, mail_id:
r3y2FCViBjp5, Hits: 0.29, size: 131795, queued_as: 3F22720232F, 7428 ms
Jul 22 17:23:08 ffiore amavis[20757]: (20757-05) TIMING-SA total 6958 ms
- parse: 4 (0.1%), extract_message_metadata: 7 (0.1%),
get_uri_detail_list: 92 (1.3%), tests_pri_-1000: 4 (0.1%),
tests_pri_-950: 1.53 (0.0%), tests_pri_-900: 1.25 (0.0%),
tests_pri_-400: 1.11 (0.0%), tests_pri_0: 6829 (98.1%),
check_dkim_signature: 3 (0.0%), check_dkim_adsp: 5 (0.1%), check_pyzor:
0.20 (0.0%), tests_pri_500: 3 (0.0%), get_report: 1.09 (0.0%)
Jul 22 17:23:08 ffiore amavis[20757]: (20757-05) TIMING [total 7431 ms]
- SMTP greeting: 2 (0%)0, SMTP EHLO: 1 (0%)0, SMTP pre-MAIL: 0 (0%)0,
SMTP pre-DATA-flush: 3 (0%)0, SMTP DATA: 44 (1%)1, check_init: 1 (0%)1,
digest_hdr: 1 (0%)1, digest_body: 2 (0%)1, gen_mail_id: 2 (0%)1,
mime_decode: 9 (0%)1, get-file-type1: 10 (0%)1, decompose_part: 54
(1%)2, parts_decode: 0 (0%)2, check_header: 2 (0%)2, AV-scan-1: 43
(1%)2, spam-wb-list: 2 (0%)2, SA parse: 5 (0%)2, SA check: 6952 (94%)96,
update_cache: 6 (0%)96, decide_mail_destiny: 0 (0%)96, fwd-connect: 5
(0%)96, fwd-mail-pip: 1 (0%)96, fwd-rcpt-pip: 0 (0%)96, fwd-data-chkpnt:
0 (0%)96, write-header: 1 (0%)96, fwd-data-contents: 48 (1%)97,
fwd-end-chkpnt: 226 (3%)100, prepare-dsn: 1 (0%)100, main_log_entry: 8
(0%)100, update_snmp: 1 (0%)100, SMTP pre-response: 0 (0%)100, SMTP
response: 0 (0%)100, unlink-2-files: 0 (0%)100, rundown: 1 (0%)100

Most of the overhead is for "tests_pri_0" (98.1%).

System info:

# perl -v
This is perl, v5.10.0 built for x86_64-linux-thread-multi

# amavisd -V
amavisd-new-2.6.6 (20110518)

# clamd -V
ClamAV 0.97.1/13321/Thu Jul 14 16:06:26 2011

# spamd -V
SpamAssassin Server version 3.2.5
  running on Perl 5.10.0

CPU:     Intel(R) Pentium(R) 4 CPU 3.00GHz (HT)
RAM:     2GB

I've already compiled the SA rules with sa_compile command.
How can I tune SA for a faster spam check?

Thanks a lot!

Francesco
-- 

*Francesco Fiore*
System Engineer
Babel S.r.l. - http://www.babel.it <http://www.babel.it/>
*T:* 06.9826.9600 *F:* 06.9826.9680
P.zza S.Benedetto da Norcia, 33 - 00040 Pomezia (Roma)
------------------------------------------------------------------------
CONFIDENZIALE: Questo messaggio ed i suoi allegati sono di carattere
confidenziale per i destinatari in indirizzo.
E' vietato l'inoltro non autorizzato a destinatari diversi da quelli
indicati nel messaggio originale.
Se ricevuto per errore, l'uso del contenuto e' proibito; si prega di
comunicarlo al mittente e cancellarlo immediatamente.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.amavis.org/pipermail/amavis-users/attachments/20110722/66314763/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: logo.gif
Type: image/gif
Size: 1983 bytes
Desc: not available
URL: <http://lists.amavis.org/pipermail/amavis-users/attachments/20110722/66314763/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 554 bytes
Desc: OpenPGP digital signature
URL: <http://lists.amavis.org/pipermail/amavis-users/attachments/20110722/66314763/attachment.pgp>