[rsyslog] untra-reliable speed test

[david at lang.hm]

I've completed my first round of testing

this is a a fusionio SSD card with a 8-core opteron system, 8G ram

running debian Lenny (debian 5) 2.6.26 kernel

rsyslog.conf

$ModLoad imuxsock # provides support for local system logging
$ModLoad imklog   # provides kernel logging support (previously done by rklogd)
$ActionFileDefaultTemplate RSYSLOG_TraditionalFileFormat
$WorkDirectory /logs
$HUPisRestart off
$MainMsgQueueCheckpointInterval 1
$MainMsgQueueFilename mainq
$MainMsgQueueType disk
$OptimizeForUniprocessor off

#$ActionfileEnableSync on
#$ActionQueueCheckpointInterval 1
#$ActionQueueFileName queue1
#$ActionQueueType disk
*.*             /logs/messages;RSYSLOG_TraditionalFileFormat


input provided by cat largefile | logger


I did tests with and without the action queue stuff enabled

the results were not quite what I expected, but interesting

xfs w/ actionqueue   1200/sec
xfs                  2000/sec
ext3 w/actionqueue   2000/sec
ext3                 4600/sec
ext4 w/actionqueue   2000/sec
ext4                 4000/sec
ext2 w/actionqueue   5300/sec
ext2                 7400/sec

note that with ext2 I don't think the input could keep up (there were not 
multiple queue files the way there were for all the others), when I 
shifted to infile as input the ext2 rate increased to ~7800/sec, and the 
cpu utilization dropped by 50-70%

I have not yet tried anything with multiple worker threads.

I captured some strace files and have posted them at 
http://rsyslog.lang.hm/rsyslog

David Lang