Fine Tuning TinyLlama on Custom Dataset | Large Language Models (LLMs)

Опубликовано: 16 Апрель 2024
на канале: Rohan-Paul-AI
709
23

Finetuning TinyLlama model which is a very small but good-performing model.

It was trained only on 3 trillion tokens.

For this fine-tuning, the purpose is to make teach the model the common words in and the style of Taylor Swift's song lyrics.

So there is no separate instruction here in the dataset.

Code: https://github.com/rohan-paul/LLM-Fin...

🐦 TWITTER:   / rohanpaul_ai  

Checkout the MASSIVELY UPGRADED 2nd Edition of my Book (with 1300+ pages of Dense Python Knowledge) 🐍🔥

Covering 350+ Python 🐍 Core concepts ( 1300+ pages ) 🚀

🟠 Book Link - https://rohanpaul.gumroad.com/l/pytho...

-----------------

Hi, I am a Machine Learning Engineer | Kaggle Master. Connect with me on 🐦 TWITTER:   / rohanpaul_ai   - for daily in-depth coverage of Large Language Model bits

----------------

You can find me here:

**********************************************

🐦 TWITTER:   / rohanpaul_ai  
👨🏻‍💼 LINKEDIN:   / rohan-paul-ai  
👨‍🔧 Kaggle: https://www.kaggle.com/paulrohan2020
👨‍💻 GITHUB: https://github.com/rohan-paul
🧑‍🦰 Facebook Page:   / rohanpaulai  
📸 Instagram:   / rohan_paul_2020  


**********************************************


Other Playlist you might like 👇

🟠 MachineLearning & DeepLearning Concepts & interview Question Playlist - https://bit.ly/380eYDj

🟠 ComputerVision / DeepLearning Algorithms Implementation Playlist - https://bit.ly/36jEvpI

🟠 DataScience | MachineLearning Projects Implementation Playlist - https://bit.ly/39MEigt

🟠 Natural Language Processing Playlist : https://bit.ly/3P6r2CL

----------------------

#LLM #Largelanguagemodels #Llama2 #LLMfinetuning #opensource #NLP #ArtificialIntelligence #datascience #textprocessing #deeplearning #deeplearningai #100daysofmlcode #neuralnetworks #datascience #generativeai #generativemodels #OpenAI #GPT #GPT3 #GPT4 #chatgpt #genai


Смотрите видео Fine Tuning TinyLlama on Custom Dataset | Large Language Models (LLMs) онлайн, длительностью часов минут секунд в хорошем качестве, которое загружено на канал Rohan-Paul-AI 16 Апрель 2024. Делитесь ссылкой на видео в социальных сетях, чтобы ваши подписчики и друзья так же посмотрели это видео. Данный видеоклип посмотрели 709 раз и оно понравилось 23 посетителям.