Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Improving the Accuracy of Domain Specific Tasks with LLM Distillation

Snorkel AI via YouTube

Overview

Coursera Plus Monthly Sale: All Certificates & Courses 40% Off!
In this 49-minute webinar from Snorkel AI, Shane Johnson presents a scalable approach to LLM distillation for improving domain-specific task accuracy. Learn how to adapt large language models to real-world applications by distilling them into smaller, more efficient models that maintain high performance while reducing latency and costs. Discover techniques including weak supervision, labeling functions, and limited-data fine-tuning that help teams transition from foundation models to production-ready solutions. The presentation covers the challenges of deploying LLMs, evaluation methods for domain-specific tasks, architectural considerations for distilled models, and real enterprise case studies. Perfect for AI teams seeking to balance accuracy, speed, and resource efficiency when deploying specialized models. The webinar includes detailed segments on cost challenges, real-world AI complexity, model combinations, deployment tradeoffs, and comparative performance analysis.

Syllabus

00:00:01 - Intro & Webinar Overview
00:03:19 - The Cost Challenge of LLMs
00:06:17 - Complexity in Real-World AI Tasks
00:09:34 - Evaluating Domain-Specific Accuracy
00:12:41 - Ranking and Response Generation
00:15:58 - Using DistilBERT and Model Combinations
00:19:25 - Tools for Efficient LLM Distillation
00:22:45 - Architecture of Distilled Models
00:26:11 - Presentation Format and Flow
00:29:34 - Use of Labeled and Weak Data
00:32:57 - Tradeoffs in Deploying Large Models
00:36:15 - Case Study: Enterprise Deployment
00:39:28 - Generalization vs Specialization
00:42:52 - Model Size and Performance Comparison
00:46:20 - Final Thoughts & Q&A

Taught by

Snorkel AI

Reviews

Start your review of Improving the Accuracy of Domain Specific Tasks with LLM Distillation

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.