Apache Kafka is publish-subscribe messaging rethought as a distributed commit log. It is used within LinkedIn for metrics and intra-application queuing.
Will give an overview on how we leverage kafka for the log aggregation (ELK) and service monitoring.
I am SRE Manager at LinkedIn with 8 years of industry experience. ELK and kafka are integral part of my day to day activity, apart from my regular responsibilities I build and manager ELK cluster for various team.
I am a technology enthusiasts and passionate on developing large scale infrastructure, I believe complex and large operations don’t necessarily have to be complex, simplicity is the best way.
Watch video Muzammil Rehman - How LinkedIn is leveraging kafka for log aggregation and monitoring online, duration hours minute second in high quality that is uploaded to the channel Hasgeek TV 17 May 2015. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 1,617 times and liked it 16 visitors.