Monitor Apache Airflow with StatsD | Prometheus | Grafana | part2

Published: 23 September 2021
on channel: MaxcoTec Learning
11,732
146

#apacheairflow #airflowforbeginners #airflowmetrics #statsd #prometheus #grafana

This is the second part of Airflow Monitoring Metric, in which we will continue working on building airflow metrics.
Watch the first part here:
   • Monitor Apache Airflow with StatsD | ...  


We will learn about how to monitor airflow cluster by taking advantages of useful airflow statsd metrics. This video covers following;

00:00 Intro
00:48 write Prometheus service
02:26 check Prometheus metrics
04:19 write Grafana service
05:07 configure grafana data source
05:44 build grafana dashboard
07:12 configuring dashboard
09:10 writing custom metrics
12:52 test custom metrics
14:09 build grafana panel for custom metrics
15:43 outro

---------------------------------------------------

Learn Something New Below:

https://maxcotec.com/blog/introductio...

https://maxcotec.com/blog/what-is-ncr...

👍 If this video was helpful to you, please don't forget to thumbs-up,
⌨️ leave a comment and
🔗 share with your friends.

⭐ Support our work by hitting that subscribe button.
🔔 hit bell icon to stay alert on more upcoming interesting stuff.

Get complete code from here;
https://github.com/maxcotec/Apache-Ai...

Grafana and StatsD configs
https://github.com/databand-ai/airflo...

Statsd python client
https://github.com/jsocol/pystatsd

Watch Part 1 here:
   • Monitor Apache Airflow with StatsD | ...  

Watch how to run airflow locally via Docker
   • Build your first pipeline DAG | Apach...  


Watch video Monitor Apache Airflow with StatsD | Prometheus | Grafana | part2 online, duration hours minute second in high quality that is uploaded to the channel MaxcoTec Learning 23 September 2021. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 11,732 times and liked it 146 visitors.