Comments on: How Rapid is Rapid? How Quick is Quick? http://rocksolid.gibraltarsoftware.com/development/logging/how-rapid-is-rapid-how-quick-is-quick Notes from the folks behind Gibraltar Software Sat, 10 Dec 2011 21:22:19 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: jay http://rocksolid.gibraltarsoftware.com/development/logging/how-rapid-is-rapid-how-quick-is-quick/comment-page-1#comment-11 jay Wed, 13 May 2009 22:42:37 +0000 http://rocksolid.gibraltarsoftware.com/?p=13#comment-11 The calculation of 6000 msgs/sec was based on extremely simplistic code that opened/closed a file for each message. By simply keeping the file open Kendall showed that the speed could easily be increased 24x to 142,000 msgs/sec. His point was that, for most systems, an average load of even 6000 msg/second is way more than needed. A second important point that was not discussed in the article is that even if the logging rate is slow, NotePad or it's ilk become utterly useless for making sense out of log data. This is why our product, Gibraltar, has great mechanisms for searching, filtering and highlighting log messages as well as graphing related metrics. We also analyze data across multiple logs. More info on Gibraltar and a free trial is available at www.GibraltarSoftware.com The calculation of 6000 msgs/sec was based on extremely simplistic code that opened/closed a file for each message. By simply keeping the file open Kendall showed that the speed could easily be increased 24x to 142,000 msgs/sec.

His point was that, for most systems, an average load of even 6000 msg/second is way more than needed.

A second important point that was not discussed in the article is that even if the logging rate is slow, NotePad or it’s ilk become utterly useless for making sense out of log data.

This is why our product, Gibraltar, has great mechanisms for searching, filtering and highlighting log messages as well as graphing related metrics. We also analyze data across multiple logs.

More info on Gibraltar and a free trial is available at http://www.GibraltarSoftware.com

]]> By: Pave http://rocksolid.gibraltarsoftware.com/development/logging/how-rapid-is-rapid-how-quick-is-quick/comment-page-1#comment-10 Pave Wed, 13 May 2009 19:18:18 +0000 http://rocksolid.gibraltarsoftware.com/?p=13#comment-10 Hey Kendall, pretty cool article, and also got me thinking. I have developed a custom logging system for my project, and it takes speed into very serious consideration, you can check it out, its open source at www.openforexplatform.com However my point is 6,000 messages per second is not so much at all, the system I mentioned does a few times that under *medium* load. Now if you use a Notepad to look trough your traces, this amount will most certainly be utterly useless, that is why I developed a sophisticated UI control to go with the logging system. It allows searching, filtering by class, by type, by importance etc. So now ever though I have 150,000+ items in my list view, I can very promptly find anything I need inside it (most often errors, warnings etc.) Hey Kendall, pretty cool article, and also got me thinking.
I have developed a custom logging system for my project, and it takes speed into very serious consideration, you can check it out, its open source at http://www.openforexplatform.com

However my point is 6,000 messages per second is not so much at all, the system I mentioned does a few times that under *medium* load. Now if you use a Notepad to look trough your traces, this amount will most certainly be utterly useless, that is why I developed a sophisticated UI control to go with the logging system. It allows searching, filtering by class, by type, by importance etc.

So now ever though I have 150,000+ items in my list view, I can very promptly find anything I need inside it (most often errors, warnings etc.)

]]>