[rsyslog] [PERFORM] performance for high-volume loginsertion(fwd)

[david at lang.hm]

On Fri, 24 Apr 2009, Rainer Gerhards wrote:

>> -----Original Message-----
>> From: rsyslog-bounces at lists.adiscon.com [mailto:rsyslog-
>> bounces at lists.adiscon.com] On Behalf Of david at lang.hm
>
>> that logic can work for every module that needs it, so this shouldn't
>> be
>> an issue.. I was mixing up the API with the need for a config variable.
>>
>> David Lang
>
> Lol, our messages crossed. Still the question is if the stringbuilder should
> support this mode. If so, we need to make deep changes to the way the
> property replacer works, thus I am hesitant to do this without real needs
> (not just because of the work to be done, but also because of the extra
> complexity [read: bugs, performance] it introduces).

if the string builder is not in the core, the output module can do the 
work for 'mid' as/if needed.

table it for now.

food for thought (which may affect the decision when it happens), there is 
benifit in doing the database equivalent of dynafiles (inserting into 
different tables depending on the contents of the message) for pretty much 
the same reasons it's useful to do for flat files.

the part that does the string building needs to know about 
dynafiles/'dynatables' and craft the strings to be written accordingly.

since syslog does not guarentee the order of events, selecting 'like' 
items from the set that have been provided to it and grouping accordingly 
is well within the right of the output side of things.

David Lang