Lina Palianytsia - Metrics: Holistic Health Metrics of ML-Based Product

Опубликовано: 16 Август 2023
на канале: Toronto Machine Learning Series (TMLS)
124
8

Speaker Bio -
Lina Palianytsia is a Lead Machine Learning Engineer at GlobalLogic.

Talk Abstract -
Common objective for ML-based products is to always be sure that the whole system produces correct results.
Depending on a domain, this problem could be less or more critical. For example, in the finance and health industries, errors could be very pricey. Building a holistic metrics system that covers all blocks of the application will help to avoid errors, react fast when they occur, and reduce manual work.
In my presentation, I will describe WHERE and WHEN to collect those metrics (data level, model level, post-model level, business level; after training, regularly on prod, live alerting on product run). Also, I will mention important aspects that you should pay attention to: making the metrics easy accessible; taking time and effort for new metrics tool to be adapted by your colleges; not hesitating to alter metrics to fulfill your needs
The model's accuracy is not enough. Learn how to cover your product with metrics so you can finally sleep better.


Смотрите видео Lina Palianytsia - Metrics: Holistic Health Metrics of ML-Based Product онлайн, длительностью часов минут секунд в хорошем качестве, которое загружено на канал Toronto Machine Learning Series (TMLS) 16 Август 2023. Делитесь ссылкой на видео в социальных сетях, чтобы ваши подписчики и друзья так же посмотрели это видео. Данный видеоклип посмотрели 124 раз и оно понравилось 8 посетителям.