Explore a comprehensive MIT lecture that delves into the intricacies of Long-Context Large Language Models (LLMs) as part of the EfficientML.ai series. Led by Professor Song Han, this 74-minute session examines advanced concepts in language model development, focusing specifically on handling extended context lengths in LLMs. Learn about the technical challenges, architectural considerations, and innovative solutions for processing and managing long-form text sequences in modern language models. Access accompanying lecture materials through the EfficientML.ai platform to enhance understanding of this cutting-edge topic in artificial intelligence and machine learning.
Overview
Syllabus
EfficientML.ai Lecture 15 - Long-Context LLM (MIT 6.5940, Fall 2024)
Taught by
MIT HAN Lab
Related Courses
-
Long-Context Large Language Models - Lecture 15
-
Transformer and Large Language Models - Part II - Lecture 13
-
Transformer and Large Language Models - Part II - Lecture 13
-
LLM Post-Training Techniques - Lecture 14
-
TinyEngine: Transformer and Large Language Models - Lecture 12
-
Transformer and Large Language Models - Part I - Lecture 12
