The log: The lifeblood of your data pipeline - O'Reilly Radar

April 30, 2015

via http://radar.oreilly.com/2015/04/the-log-the-lifeblood-of-your-data-pipeline.html

Interesting article. I hadn’t heard of Fluentd, looks useful.

oreilly_radar_fluentd_1
The old paradigm — machines to humans, and the new — machines to machines. Image courtesy of Kiyoto Tamura.
Over the last decade, the primary consumer of log data shifted from humans to machines.
Software engineers still read logs, especially when their software behaves in an unexpected manner. However, in terms of “bytes processed,” humans account for a tiny fraction of the total consumption.
image from The log: The lifeblood of your data pipeline - O'Reilly Radar