The Elasticsearch ELK Stack

( E – Elasticsearch, L – Logstash , K – Kibana )

Elasticsearch ( search, analyze in real-time. sweet.)
—————–
Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine. Architected from the ground up for use in distributed environments where reliability and scalability are must haves, Elasticsearch gives you the ability to move easily beyond simple full-text search. Through its robust set of APIs and query DSLs, plus clients for the most popular programming languages, Elasticsearch delivers on the near limitless promises of search technology.

Logstash ( scrub, parse, and enrich like soap for your data.)
——–
Logstash helps you take logs and other time based event data from any system and store it in a single place for additional transformation and processing. Logstash will scrub your logs and parse all data sources into an easy to read JSON format. The most popular open source logging solution in the market today, Logstash lets users get up and running in just minutes.
Kibana ( line graphs, pie charts… yeah we got that.)
——
Kibana is Elasticsearch’s data visualization engine, allowing you to natively interact with all your data in Elasticsearch via custom dashboards. Kibana’s dynamic dashboard panels are savable, shareable and exportable, displaying changes to queries into Elasticsearch in real-time. You can perform data analysis in Kibana’s beautiful user interface using pre-designed dashboards or update these dashboards in real-time for on-the-fly data analysis.
By combining the massively popular Elasticsearch, Logstash and Kibana they have created an end-to-end stack that delivers actionable insights in real-time from almost any type of structured and unstructured data source. Built and supported by the engineers behind each of these open source products, the Elasticsearch ELK stack makes searching and analyzing data easier than ever before.

Used as a stand-alone application to provide strategic business insights or integrate with your existing applications to power their interactions with incoming data. Thousands of organizations worldwide use the Elasticsearch ELK stack for an endless variety of business critical functions.

marvel ( manage and monitor your elasticsearch deployment)

Want to get full transparency into the state of your deployment and manage your clusters towards optimal health? Elasticsearch Marvel instantly provides much-needed visibility into a deployment, both in real time and historically, making it simple to understand the root cause of any issue with your Elasticsearch clusters. Free during development.

Source : http://www.elasticsearch.org/overview/