POST

The log: The lifeblood of your data pipeline - O'Reilly Radar

via http://radar.oreilly.com/2015/04/the-log-the-lifeblood-of-your-data-pipeline.html

Interesting article. I hadn’t heard of Fluentd, looks useful.

The old paradigm — machines to humans, and the new — machines to machines. Image courtesy of Kiyoto Tamura.

Over the last decade, the primary consumer of log data shifted from humans to machines.

Software engineers still read logs, especially when their software behaves in an unexpected manner. However, in terms of “bytes processed,” humans account for a tiny fraction of the total consumption.

• Tags:
• zznippets
• bigdata
• logging