Monitor Apache Airflow with StatsD | Prometheus | Grafana | part2

Опубликовано: 23 Сентябрь 2021
на канале: MaxcoTec Learning
11,732
146

#apacheairflow #airflowforbeginners #airflowmetrics #statsd #prometheus #grafana

This is the second part of Airflow Monitoring Metric, in which we will continue working on building airflow metrics.
Watch the first part here:
   • Monitor Apache Airflow with StatsD | ...  


We will learn about how to monitor airflow cluster by taking advantages of useful airflow statsd metrics. This video covers following;

00:00 Intro
00:48 write Prometheus service
02:26 check Prometheus metrics
04:19 write Grafana service
05:07 configure grafana data source
05:44 build grafana dashboard
07:12 configuring dashboard
09:10 writing custom metrics
12:52 test custom metrics
14:09 build grafana panel for custom metrics
15:43 outro

---------------------------------------------------

Learn Something New Below:

https://maxcotec.com/blog/introductio...

https://maxcotec.com/blog/what-is-ncr...

👍 If this video was helpful to you, please don't forget to thumbs-up,
⌨️ leave a comment and
🔗 share with your friends.

⭐ Support our work by hitting that subscribe button.
🔔 hit bell icon to stay alert on more upcoming interesting stuff.

Get complete code from here;
https://github.com/maxcotec/Apache-Ai...

Grafana and StatsD configs
https://github.com/databand-ai/airflo...

Statsd python client
https://github.com/jsocol/pystatsd

Watch Part 1 here:
   • Monitor Apache Airflow with StatsD | ...  

Watch how to run airflow locally via Docker
   • Build your first pipeline DAG | Apach...  


Смотрите видео Monitor Apache Airflow with StatsD | Prometheus | Grafana | part2 онлайн, длительностью часов минут секунд в хорошем качестве, которое загружено на канал MaxcoTec Learning 23 Сентябрь 2021. Делитесь ссылкой на видео в социальных сетях, чтобы ваши подписчики и друзья так же посмотрели это видео. Данный видеоклип посмотрели 11,732 раз и оно понравилось 146 посетителям.