Refactoring A Data Science Project Part 1 - Abstraction and Composition

Published: 08 October 2021
on channel: ArjanCodes

77,918

2.8k

💡 Learn how to design great software in 7 steps: https://arjan.codes/designguide.

This is the first part of a 3-part miniseries in which I refactor a hand-written digit recognition data science project based on the MNIST dataset to improve the software design so it's easier to reuse and adapt. In this first part I cover using abstract classes and protocols to better separate the various aspects of the application, and I talk about function composition as a generic solution to dealing with data pipelines.

Links to Pytorch and Scikit learn functional composition tools:
https://pytorch.org/docs/stable/gener...
https://scikit-learn.org/stable/modul...

Part 1: • Refactoring A Data Science Project Pa...
Part 2: • Refactoring A Data Science Project Pa...

🎓 ArjanCodes Courses: https://www.arjancodes.com/courses/

🔖 Chapters:
0:00 Intro
1:29 Explaining the code
6:41 About data science
7:35 Separating experiment tracking from the rest of the code
16:52 Improving data type consistency
19:44 Improving the way variables are handled
22:26 About function composition
29:03 Final thoughts

#arjancodes #softwaredesign #python

Watch video Refactoring A Data Science Project Part 1 - Abstraction and Composition online, duration hours minute second in high quality that is uploaded to the channel ArjanCodes 08 October 2021. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 77,918 times and liked it 2.8 thousand visitors.

4,087