Real-Time Performance Analysis of Data-Processing Pipelines with Spring Cloud Data Flow, Micrometer

October 18, 2019
Real-time monitoring is a critical capability for building and operating distributed, data-intensive applications at scale. While Spring Cloud Data Flow (SCDF) helps you orchestrate streaming and batch data pipelines on multiple platforms, the Micrometer integration, on the other hand, provides the mechanism to collect multidimensional performance metrics. SCDF leverages Micrometer to provide a turnkey solution to collect, curate, and visualize key statistics of streaming and batch data pipelines. With practical code examples, we'll demonstrate how to consistently produce structured metrics (both for streaming and batch data pipelines) to Prometheus, and how to visualize them with dashboards such as Grafana. From an observability standpoint, we'll share the best practices to monitor the data-intensive applications running in Cloud Foundry and Kubernetes, which could be the basis for throughput-based elastic autoscaling. Speakers: Christian Tzolov, Principal Software Engineer, Pivotal and Sabby Anandan, Principal Product Manager, Pivotal Filmed at SpringOne Platform 2019 Slides: https://www.slideshare.net/SpringCentral/realtime-performance-analysis-of-dataprocessing-pipelines-with-spring-cloud-data-flow-micrometer
Previous
Scalable, Cloud-Native Data Applications by Example
Scalable, Cloud-Native Data Applications by Example

Cloud platforms provide scale and a ton of powerful services. With these options comes the challenge of cho...

Next Video
Data Serialization and CI/CD Techniques for Apache Geode
Data Serialization and CI/CD Techniques for Apache Geode

Since Apache Geode is implemented in Java, data serialization has always been an important topic for discus...