Big Data Spain

17th ~ 18th NOV 2016 MADRID, SPAIN #BDS16

Awesome Logging Infrastructure Using The Elastic Stack

Thursday 17th

from 14:50 to 15:30

Theatre 20



One of the hottest and most widely used tools for log monitoring and analytics at the moment is the Elastic Stack. It consists of the following four open source components:
* Elasticsearch doing the hard work of analyzing, storing, and searching large amounts of data. It scales horizontally and has taken over the world of full-text search in a storm, but can also be used for logging, auditing, time-series, and more.
* Logstash for parsing and enrichment. It is the swiss army knife of integrating different technologies. More than 200 plugins are readily available, but you can easily add your own by writing a few lines of Ruby.
* Beats as a lightweight agent or forwarder. Written in Go it provides you with native binaries for one specific task like collecting (log) files, monitoring your system, gathering network headers, and more. You can put these on hundreds or even thousands of servers without fearing major performance penalties.
* Kibana for powerful visualizations. It will democratize your data — everybody can participate and gain insights from your information pool.

This workshop gives you an overview of the four technologies, how they are working together, and how they can solve your problems. We dive right into demos and work through all the moving parts in an interactive fashion.

Philip Krenn foto

Philip Krenn

ElasticDeveloper Advocate