Fine-tuning Large Language Models (LLMs) | w/ Example Code

👉Need help with AI? Reach out: shawhintalebi.com/ 🎥Series playlist: youtube.com/playlist?list=PLz-ep5RbHosU2hnz5ejezwa… -- [1] deeplearning.ai/ Finetuning Large Langauge Models Short Course: www.deeplearning.ai/short-courses/finetuning-large… [2] arXiv:2005.14165 [cs.CL] (GPT-3 Paper) [3] arXiv:2303.18223 [cs.CL] (Survey of LLMs) [4] arXiv:2203.02155 [cs.CL] (InstructGPT paper) [5] PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware: huggingface.co/blog/peft [6] arXiv:2106.09685 [cs.CL] (LoRA paper) [7] Original dataset source — Andrew L. Maas, Raymond E. Daly, Peter T. Pham, Dan Huang, Andrew Y. Ng, and Christopher Potts. 2011. Learning Word Vectors for Sentiment Analysis. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 142–150, Portland, Oregon, USA. Association for Computational Linguistic

Honestly the most straightforward explanation I've ever watched. Super excellent work Shaw. Thank you. It's so rare to find good communicators like you!

Great video Shaw! It was a good balance between details and concepts. Very unusual to see this so well done. Thank you.

Such a great video. This is the first one I watched from you. You explain everything so nicely, and in my opinion you provided just the right amount of information - not too little, so it doesn't feel superficial and you feel like you've learned something, but not too much, so that you can take what you've learned and read more about it yourself if you're interested. Looking forward to seeing more of your content!

Just came to this video from HF and I have to say, I love they way you describe this! Thanks for the great video!

A very clear and straightforward video explaining finetuning.

Your style of conveying information is wonderful. Good luck to you

You have explained this so clearly, that even a novice in NLP can understand it.

Great video, I wanted to hear further discussion on mitigation techniques for overfitting. Thanks for making the video!

Amazing video Shawhin. It was quite easy to follow and stuff were clearly explained. Thank you so much,

This was one of the best videos on this topic, really nice man, keep going.

Wow dude, just you wait, this channel is gonna go viral! You explain everything so clearly, wish you led the courses at my university.

excellent simple explanation to the point. Love it !

Thank you for the detailed explaination line by line. Finally a place, I can rely on with working example

Fantastic video. Thanks for the upload. Keep up the good work, you're awesome 😎

Excellent way of teaching. Keep doing this kind of good work.

Clear and straightforward to the point, thanks a lot for making this valuable content accessible on ytb💡

Im really gratful for youre work , you really help me when I had no one to ask .

Even though this was high level instruction, it was perfect. I can continue from here. Thanks Shahin jan!

Clear Explanation, Amazing