Kafka as a Platform: the Ecosystem from the Ground Up - Robin Moffatt

Published: 10 November 2020
on channel: NDC Conferences
1,147
22

Kafka has become a key data infrastructure technology, and we all have at least a vague sense that it is a messaging system, but what else is it? How can an overgrown message bus be getting this much buzz? Well, because Kafka is merely the center of a rich streaming data platform that invites detailed exploration.

In this talk, we’ll look at the entire streaming platform provided by Apache Kafka and the Confluent community components. Starting with a lonely key-value pair, we’ll build up topics, partitioning, replication, and low-level Producer and Consumer APIs. We’ll group consumers into elastically scalable, fault-tolerant application clusters, then layer on more sophisticated stream processing APIs like Kafka Streams and ksqlDB. We’ll help teams collaborate around data formats with schema management. We’ll integrate with legacy systems without writing custom code. By the time we’re done, the open-source project we thought was Big Data’s answer to message queues will have become an enterprise-grade streaming platform, all in 60 minutes.


Check out more of our talks at:
https://ndcoslo.com
https://www.ndcconferences.com/


Watch video Kafka as a Platform: the Ecosystem from the Ground Up - Robin Moffatt online, duration hours minute second in high quality that is uploaded to the channel NDC Conferences 10 November 2020. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 1,147 times and liked it 22 visitors.