[rsyslog] does rsyslog supports data analytic

[Rainer Gerhards]

OK, that's not very precise, but I have also thought a bit about this. What I
have proposed this morning should be possible. But you should be warned, it
requires a lot of reading and understanding the source code. A good place to
start is the template input and output modules as well as some actual output
modules. I think imdiag would be useful (because it is simple) and probably
also either omstdout (simple) and omoracle (complex, but utilizes the vector
interface which may be the best choice for what you intend to acomplish).

As a side-note, if this is paid work you may want to think about purchasing
some development help from Adiscon, which may dramatically reduce the time
you need to get started (just a thought, omoracle was crafted very well
without any such help - thanks again!).

Rainer

> -----Original Message-----
> From: rsyslog-bounces at lists.adiscon.com [mailto:rsyslog-
> bounces at lists.adiscon.com] On Behalf Of Josh Zhao
> Sent: Friday, September 11, 2009 5:10 PM
> To: rsyslog-users
> Subject: Re: [rsyslog] does rsyslog supports data analytic
> 
> Thanks Rainer. The basic purpose is statistics,which can accumulate
> some
> fields of msgs,but I think the customers have more weird requirements.
> 
> 2009/9/11 Rainer Gerhards <rgerhards at hq.adiscon.com>
> 
> > Now that I got an idea of how this could be implemented with current
> > rsyslog technology, I would be interested in some more details of
> what
> > you intend to do with the processing module. What exactly will it do
> > with the message? I am asking because I would like to see a real use
> > case. Thinking about the scenario I have proposed in my last mail, I
> > think I see some pitfalls and I am not sure if they will cause any
> > trouble in real projects.
> >
> > So I would appreciate if you could provide more in-depth info.
> >
> > Thanks,
> > Rainer
> >
> > On Thu, 2009-09-10 at 21:25 +0800, Josh Zhao wrote:
> > > Thanks for David and Rainer's reply.I m sorry that I did not
> explain my
> > > question clearly.I m new to rsyslog and want to add a processing
> module
> > in
> > > rsyslog.The rsyslog has input plugins(front-end) and output
> > > plugins(back-end).My processing module receives data from input
> plugins
> > and
> > > output the processed data and raw data both into output plugins.So
> how I
> > add
> > > it?
> > >
> > >
> > > 2009/9/10 Rainer Gerhards <rgerhards at hq.adiscon.com>
> > >
> > > > > -----Original Message-----
> > > > > From: rsyslog-bounces at lists.adiscon.com
> > > > > [mailto:rsyslog-bounces at lists.adiscon.com] On Behalf Of
> > david at lang.hm
> > > > > Sent: Thursday, September 10, 2009 8:26 AM
> > > > > To: rsyslog-users
> > > > > Subject: Re: [rsyslog] does rsyslog supports data analytic
> > > >
> > > > > >  PS: i browse the git source code, but i can't understand why
> the
> > > > > >
> > > > > Experimental-lockfree<http://git.adiscon.com/?p=rsyslog.git;a=
> > > > shortlog;h=refs/heads/Experimental-lockfree>
> > > > > > is
> > > > > > not adopted?
> > > > >
> > > > > I believe that it boils down to complications in being sure
> > > > > that there are
> > > > > no bugs, and the fact that even without that there has been a
> > > > > LOT of room
> > > > > for improvement from the early 3.x timeframe to the current
> > > > > 5.x version.
> > > > >
> > > > > I expect that after the current round of improvements are
> > > > > settled that
> > > > > aspect of things will get reexamined.
> > > >
> > > > That branch is mostly there for historical reasons. I keep that
> branch
> > as a
> > > > think-tank, but it is is obsoleted. Also, in less polite words
> than
> > David
> > > > used, it simply doesn't work. Getting this code with multiple
> producers
> > and
> > > > consumers correct is far from being trivial and the literature I
> > browsed
> > > > indicates that it is probably not possible given the other
> predicates
> > the
> > > > code must obey to. Still, optimization is high up on the todo
> list.
> > > >
> > > > Rainer
> > > > _______________________________________________
> > > > rsyslog mailing list
> > > > http://lists.adiscon.net/mailman/listinfo/rsyslog
> > > > http://www.rsyslog.com
> > > >
> > > _______________________________________________
> > > rsyslog mailing list
> > > http://lists.adiscon.net/mailman/listinfo/rsyslog
> > > http://www.rsyslog.com
> >
> > _______________________________________________
> > rsyslog mailing list
> > http://lists.adiscon.net/mailman/listinfo/rsyslog
> > http://www.rsyslog.com
> >
> _______________________________________________
> rsyslog mailing list
> http://lists.adiscon.net/mailman/listinfo/rsyslog
> http://www.rsyslog.com