Advertisement
If you have a new account but are having problems posting or verifying your account, please email us on hello@boards.ie for help. Thanks :)
Hello all! Please ensure that you are posting a new thread or question in the appropriate forum. The Feedback forum is overwhelmed with questions that are having to be moved elsewhere. If you need help to verify your account contact hello@boards.ie

Often analyzing log files?

Options
  • 17-05-2016 9:56am
    #1
    Registered Users Posts: 9


    Just a tip for those of you that spend time analyzing logs or have various scripts to get various event counts etc. Take a look at an ELK stack, Elastic Search, Logstash and Kibana.

    Some of you may have heard of it and this is old news, but in case others havent...

    The way it works is Logstash reads and parses your log file, it then passes the broken down information to Elastic Search which indexes it for fast lookup, and finally Kibana is the front end where you can do various searches.

    Its a really powerful piece of (free) software. Its made things so much easier of us when looking into issues etc. We previously had scripts to do certain things like, for a very basic example, count the number of transactions for a specific customer, in a specific time period, with a certain type of status response. In some cases something that would have taken 10-15mins to gather and graph etc now takes less than a minute.

    Well worth checking out.

    Site: elastic.co/


Comments

  • Registered Users Posts: 2,791 ✭✭✭John_Mc


    Yep, they are using it where I work and the feedback is very positive. I haven't used it yet but will be implementing it in a new project shortly.


  • Registered Users Posts: 11,262 ✭✭✭✭jester77


    Check out graylog2 as well, quality piece of software


Advertisement