Real-Time Performance Analysis of Data-Processing Pipelines with Spring Cloud Data Flow, Micrometer
Real-time monitoring is a critical capability for building and operating distributed, data-intensive applications at scale. While Spring Cloud Data Flow (SCDF) helps you orchestrate streaming and batch data pipelines on multiple platforms, the Micrometer integration, on the other hand, provides the mechanism to collect multidimensional performance metrics.
SCDF leverages Micrometer to provide a turnkey solution to collect, curate, and visualize key statistics of streaming and batch data pipelines.
With practical code examples, we'll demonstrate how to consistently produce structured metrics (both for streaming and batch data pipelines) to Prometheus, and how to visualize them with dashboards such as Grafana.
From an observability standpoint, we'll share the best practices to monitor the data-intensive applications running in Cloud Foundry and Kubernetes, which could be the basis for throughput-based elastic autoscaling.
Speakers: Christian Tzolov, Principal Software Engineer, Pivotal and Sabby Anandan, Principal Product Manager, Pivotal
Filmed at SpringOne Platform 2019
Slides: https://www.slideshare.net/SpringCent...
Watch video Real-Time Performance Analysis of Data-Processing Pipelines with Spring Cloud Data Flow, Micrometer online, duration hours minute second in high quality that is uploaded to the channel SpringDeveloper 18 October 2019. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 4,151 times and liked it 48 visitors.
