Catastrophic Forgetting depends primarily on fine-tuning loss - forgetting is unavoidable by means of early stopping or tuning a fewer (or greater) number of parameters.
Paper - "Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting"
Paper : https://arxiv.org/abs/2401.05605
🐦 Connect with me in TWITTER: / rohanpaul_ai
Checkout the MASSIVELY UPGRADED 2nd Edition of my Book (with 1300+ pages of Dense Python Knowledge) 🐍🔥
Covering 350+ Python 🐍 Core concepts ( 1300+ pages ) 🚀
🟠 Book Link - https://rohanpaul.gumroad.com/l/pytho...
-----------------
Hi, I am a Machine Learning Engineer | Kaggle Master. Connect with me on 🐦 TWITTER: / rohanpaul_ai - for daily in-depth coverage of Large Language Model bits
----------------
You can find me here:
**********************************************
🐦 TWITTER: / rohanpaul_ai
👨🏻💼 LINKEDIN: / rohan-paul-ai
👨🔧 Kaggle: https://www.kaggle.com/paulrohan2020
👨💻 GITHUB: https://github.com/rohan-paul
🧑🦰 Facebook : / rohan.paul.562
📸 Instagram: / rohan_paul_2020
**********************************************
Other Playlist you might like 👇
🟠 MachineLearning & DeepLearning Concepts & interview Question Playlist - https://bit.ly/380eYDj
🟠 ComputerVision / DeepLearning Algorithms Implementation Playlist - https://bit.ly/36jEvpI
🟠 DataScience | MachineLearning Projects Implementation Playlist - https://bit.ly/39MEigt
🟠 Natural Language Processing Playlist : https://bit.ly/3P6r2CL
----------------------
#LLM #Largelanguagemodels #Llama3 #LLMfinetuning #opensource #NLP #ArtificialIntelligence #datascience #textprocessing #deeplearning #deeplearningai #100daysofmlcode #neuralnetworks #datascience #generativeai #generativemodels #OpenAI #GPT #GPT3 #GPT4 #chatgpt #genai
Watch video Catastrophic Forgetting can NOT be avoided in Finetuned LLMs | New LLMs Paper online, duration hours minute second in high quality that is uploaded to the channel Rohan-Paul-AI 11 May 2024. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 483 times and liked it 19 visitors.