amavisd performance issues - 100% single CPU core

Matthew Scully mattz0rpwnz at googlemail.com
Fri Aug 22 11:31:28 CEST 2014


Hey Guys,

Not sure what information you would need, but I'll supply as much as
possible.

The system:

VM Running CentOS 5.10 with all the latest yum upgrades.

Kernel: 2.6.18-371.11.1.el5xen
Amavisd-new: amavisd-new-2.8.0-1.el5.rf

The problem I'm getting at the moment, is that on occasion, more often than
not, an amavisd process will hog 100% of a CPU core and just hang there, I
believe the email still gets sent, but not 100% sure!

If I check the email that's being processed by using lsof -p and then
viewing the contents of the particular email.txt - The email isn't always a
particularly big one, or contain lots of links/text/attachments.

I've tried reducing the amount of max_servers, but this still doesn't seem
to make any difference.

I'd read a thread elsewhere about the version of B DB, verified that we're
using 4.3 and not 4.1, which somehow causes problems.

IT's doing it at the moment, and the lsof reads this:

 lsof -p 13886


COMMAND   PID   USER   FD   TYPE             DEVICE  SIZE/OFF     NODE NAME
amavisd 13886 amavis  cwd    DIR              253,0      4096  3604553
/var/amavis/afs7M9H0np014573
amavisd 13886 amavis  rtd    DIR              253,0      4096        2 /
amavisd 13886 amavis  txt    REG              253,0     19200 10689782
/usr/bin/perl
amavisd 13886 amavis  mem    REG              253,0    144776 11960396
/lib64/ld-2.5.so
amavisd 13886 amavis  mem    REG              253,0   1726472 11960497
/lib64/libc-2.5.so
amavisd 13886 amavis  mem    REG              253,0     23360 11960501
/lib64/libdl-2.5.so
amavisd 13886 amavis  mem    REG              253,0    149968 11960666
/lib64/libpthread-2.5.so
amavisd 13886 amavis  mem    REG              253,0     18152 11960633
/lib64/libutil-2.5.so
amavisd 13886 amavis  mem    REG              253,0     53448 11960668
/lib64/librt-2.5.so
amavisd 13886 amavis  mem    REG              253,0     95464 11960672
/lib64/libselinux.so.1
amavisd 13886 amavis  mem    REG              253,0    114352 11960680
/lib64/libnsl-2.5.so
amavisd 13886 amavis  mem    REG              253,0     48600 11960673
/lib64/libcrypt-2.5.so
amavisd 13886 amavis  mem    REG              253,0     92816 11960664
/lib64/libresolv-2.5.so
amavisd 13886 amavis  mem    REG              253,0      9472 11960684
/lib64/libkeyutils-1.2.so
amavisd 13886 amavis  mem    REG              253,0     10096 11960682
/lib64/libcom_err.so.2.1
amavisd 13886 amavis  mem    REG              253,0   1262320 10814958
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so
amavisd 13886 amavis  mem    REG              253,0    614992 11960322
/lib64/libm-2.5.so
amavisd 13886 amavis  mem    REG              253,0     24576  3178522
/var/amavis/db/__db.001
amavisd 13886 amavis  mem    REG              253,0  56444560 10686300
/usr/lib/locale/locale-archive
amavisd 13886 amavis  mem    REG              253,0    119224 10846238
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/POSIX/POSIX.so
amavisd 13886 amavis  mem    REG              253,0     13056 10846210
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Fcntl/Fcntl.so
amavisd 13886 amavis  mem    REG              253,0     21424 10846400
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Socket/Socket.so
amavisd 13886 amavis  mem    REG              253,0     24856 10846432
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Time/HiRes/HiRes.so
amavisd 13886 amavis  mem    REG              253,0     18080 10846225
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/IO/IO.so
amavisd 13886 amavis  mem    REG              253,0     15480 10814857
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Digest/MD5/MD5.so
amavisd 13886 amavis  mem    REG              253,0     73951 10914694
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/Unix/Syslog/Syslog.so
amavisd 13886 amavis  mem    REG              253,0     61024 10913333
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/Compress/Zlib/Zlib.so
amavisd 13886 amavis  mem    REG              253,0     85544 11960611
/lib64/libz.so.1.2.3
amavisd 13886 amavis  mem    REG              253,0     12576 10846233
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/MIME/Base64/Base64.so
amavisd 13886 amavis  mem    REG              253,0     11024 10846394
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/
PerlIO/scalar/scalar.so
amavisd 13886 amavis  mem    REG              253,0     38336 10814874
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Encode/Encode.so
amavisd 13886 amavis  mem    REG              253,0     53880 11960344
/lib64/libnss_files-2.5.so
amavisd 13886 amavis  mem    REG              253,0     25952 11042886
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/Socket6/Socket6.so
amavisd 13886 amavis  mem    REG              253,0     37400 10846230
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/List/Util/Util.so
amavisd 13886 amavis  mem    REG              253,0     24848 10846391
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/
PerlIO/encoding/encoding.so
amavisd 13886 amavis  mem    REG              253,0    601959 11042877
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/BerkeleyDB/BerkeleyDB.so
amavisd 13886 amavis  mem    REG              253,0   1008656 11960502
/lib64/libdb-4.3.so
amavisd 13886 amavis  mem    REG              253,0    120443 11042905
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/Crypt/OpenSSL/RSA/RSA.so
amavisd 13886 amavis  mem    REG              253,0    320712 11960336
/lib64/libssl.so.0.9.8e
amavisd 13886 amavis  mem    REG              253,0   1365328 11960334
/lib64/libcrypto.so.0.9.8e
amavisd 13886 amavis  mem    REG              253,0    188328 10690853
/usr/lib64/libgssapi_krb5.so.2.2
amavisd 13886 amavis  mem    REG              253,0    611312 10690867
/usr/lib64/libkrb5.so.3.3
amavisd 13886 amavis  mem    REG              253,0    151176 10690857
/usr/lib64/libk5crypto.so.3.1
amavisd 13886 amavis  mem    REG              253,0     33480 10694189
/usr/lib64/libkrb5support.so.0.1
amavisd 13886 amavis  mem    REG              253,0    247496 11960369
/lib64/libsepol.so.1
amavisd 13886 amavis  mem    REG              253,0      8184 11043048
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/Net/DNS/DNS.so
amavisd 13886 amavis  mem    REG              253,0    131698 10914638
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/Digest/SHA/SHA.so
amavisd 13886 amavis  mem    REG              253,0      7192 10846426
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Sys/
Hostname/Hostname.so
amavisd 13886 amavis  mem    REG              253,0     19464 10846212
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/File/Glob/Glob.so
amavisd 13886 amavis  mem    REG              253,0     29280 10914556
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/NetAddr/IP/Util/Util.so
amavisd 13886 amavis  mem    REG              253,0     45128 11043066
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/HTML/Parser/Parser.so
amavisd 13886 amavis  mem    REG              253,0     10800 10814842
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Cwd/Cwd.so
amavisd 13886 amavis  mem    REG              253,0    437793 10914679
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-
multi/auto/Convert/UUlib/UUlib.so
amavisd 13886 amavis  mem    REG              253,0    381712 10814867
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Encode/Byte/Byte.so
amavisd 13886 amavis  mem    REG              253,0     15968 10848186
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/
Encode/Unicode/Unicode.so
amavisd 13886 amavis  mem    REG              253,0   2090744 10814870
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Encode/CN/CN.so
amavisd 13886 amavis  mem    REG              253,0   2024344 10814881
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Encode/TW/TW.so
amavisd 13886 amavis  mem    REG              253,0   2408376 10814877
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Encode/KR/KR.so
amavisd 13886 amavis  mem    REG              253,0   2745424 10814875
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Encode/JP/JP.so
amavisd 13886 amavis  mem    REG              253,0     54216 10814844
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/DB_File/DB_File.so
amavisd 13886 amavis  mem    REG              253,0     31656 10814847
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Data/Dumper/Dumper.so
amavisd 13886 amavis  mem    REG              253,0     25464 10782416
/usr/lib64/gconv/gconv-modules.cache
amavisd 13886 amavis  mem    REG              253,0    278528  3178523
/var/amavis/db/__db.002
amavisd 13886 amavis  mem    REG              253,0    663552  3178524
/var/amavis/db/__db.003
amavisd 13886 amavis    0r   CHR                1,3       0t0     1090
/dev/null
amavisd 13886 amavis    1w   CHR                1,3       0t0     1090
/dev/null
amavisd 13886 amavis    2w   CHR                1,3       0t0     1090
/dev/null
amavisd 13886 amavis    3u  unix 0xffff8800533cf140       0t0    66716
socket
amavisd 13886 amavis    4w   REG              253,0         0 10158088
/tmp/fileBP8pVO
amavisd 13886 amavis    5u  unix 0xffff880088e7b3c0       0t0    57094
/var/amavis/amavisd.sock
amavisd 13886 amavis    6u   REG              253,0     12288  3178525
/var/amavis/db/snmp.db
amavisd 13886 amavis    7u   REG              253,0     12288  3180190
/var/amavis/db/nanny.db
amavisd 13886 amavis    8u  unix 0xffff8800533cee80       0t0    70440
/var/amavis/amavisd.sock
amavisd 13886 amavis    9r   REG              253,0      1484  3604554
/var/amavis/afs7M9H0np014573/email.txt
amavisd 13886 amavis   10u  IPv4              70508       0t0      UDP
********.********.co.uk:7718->google-public-dns-a.google.com:domain
amavisd 13886 amavis   11u   REG              253,0  83918848  3178537
/var/amavis/var/.spamassassin/bayes_seen
amavisd 13886 amavis   13u   REG              253,0 335826944  3178536
/var/amavis/var/.spamassassin/bayes_toks

I've tried with berkeley DB disabled, still happens.

If you need any further information, please let me know and I'll happily
provide it!

Thanks,

Matt
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.amavis.org/pipermail/amavis-users/attachments/20140822/bf9ea758/attachment.html>


More information about the amavis-users mailing list