Fine Tuning TinyLlama on Custom Dataset | Large Language Models (LLMs)

Published: 16 April 2024
on channel: Rohan-Paul-AI
709
23

Finetuning TinyLlama model which is a very small but good-performing model.

It was trained only on 3 trillion tokens.

For this fine-tuning, the purpose is to make teach the model the common words in and the style of Taylor Swift's song lyrics.

So there is no separate instruction here in the dataset.

Code: https://github.com/rohan-paul/LLM-Fin...

🐦 TWITTER:   / rohanpaul_ai  

Checkout the MASSIVELY UPGRADED 2nd Edition of my Book (with 1300+ pages of Dense Python Knowledge) 🐍🔥

Covering 350+ Python 🐍 Core concepts ( 1300+ pages ) 🚀

🟠 Book Link - https://rohanpaul.gumroad.com/l/pytho...

-----------------

Hi, I am a Machine Learning Engineer | Kaggle Master. Connect with me on 🐦 TWITTER:   / rohanpaul_ai   - for daily in-depth coverage of Large Language Model bits

----------------

You can find me here:

**********************************************

🐦 TWITTER:   / rohanpaul_ai  
👨🏻‍💼 LINKEDIN:   / rohan-paul-ai  
👨‍🔧 Kaggle: https://www.kaggle.com/paulrohan2020
👨‍💻 GITHUB: https://github.com/rohan-paul
🧑‍🦰 Facebook Page:   / rohanpaulai  
📸 Instagram:   / rohan_paul_2020  


**********************************************


Other Playlist you might like 👇

🟠 MachineLearning & DeepLearning Concepts & interview Question Playlist - https://bit.ly/380eYDj

🟠 ComputerVision / DeepLearning Algorithms Implementation Playlist - https://bit.ly/36jEvpI

🟠 DataScience | MachineLearning Projects Implementation Playlist - https://bit.ly/39MEigt

🟠 Natural Language Processing Playlist : https://bit.ly/3P6r2CL

----------------------

#LLM #Largelanguagemodels #Llama2 #LLMfinetuning #opensource #NLP #ArtificialIntelligence #datascience #textprocessing #deeplearning #deeplearningai #100daysofmlcode #neuralnetworks #datascience #generativeai #generativemodels #OpenAI #GPT #GPT3 #GPT4 #chatgpt #genai


Watch video Fine Tuning TinyLlama on Custom Dataset | Large Language Models (LLMs) online, duration hours minute second in high quality that is uploaded to the channel Rohan-Paul-AI 16 April 2024. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 709 times and liked it 23 visitors.