Lina Palianytsia - Metrics: Holistic Health Metrics of ML-Based Product
Speaker Bio -
Lina Palianytsia is a Lead Machine Learning Engineer at GlobalLogic.
Talk Abstract -
Common objective for ML-based products is to always be sure that the whole system produces correct results.
Depending on a domain, this problem could be less or more critical. For example, in the finance and health industries, errors could be very pricey. Building a holistic metrics system that covers all blocks of the application will help to avoid errors, react fast when they occur, and reduce manual work.
In my presentation, I will describe WHERE and WHEN to collect those metrics (data level, model level, post-model level, business level; after training, regularly on prod, live alerting on product run). Also, I will mention important aspects that you should pay attention to: making the metrics easy accessible; taking time and effort for new metrics tool to be adapted by your colleges; not hesitating to alter metrics to fulfill your needs
The model's accuracy is not enough. Learn how to cover your product with metrics so you can finally sleep better.
Watch video Lina Palianytsia - Metrics: Holistic Health Metrics of ML-Based Product online, duration hours minute second in high quality that is uploaded to the channel Toronto Machine Learning Series (TMLS) 16 August 2023. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 124 times and liked it 8 visitors.
