Compressing AI Models (LLMs) using Distillation, Quantization, and Pruning
1:12
YouTubeRajistics - data science, AI, and machine learning
Compressing AI Models (LLMs) using Distillation, Quantization, and Pruning
A couple of techniques we use to compress models. This saves GPU memory and can reduce the amount of compute needed. Model distillation compresses a large model’s knowledge into a smaller one, quantization reduces memory usage by representing parameters with fewer bits, and pruning streamlines the model by removing less important weights ...
2.8K viewsFeb 2, 2025
Knowledge Distillation Tutorial
Understanding Knowledge Distillation in Neural Sequence Generation - Microsoft Research
1:18:05
Understanding Knowledge Distillation in Neural Sequence Generation - Microsoft Research
Microsoft
Jan 17, 2020
Knowledge Distillation: Principles, Algorithms, Applications
Knowledge Distillation: Principles, Algorithms, Applications
neptune.ai
Jul 22, 2022
What is Knowledge distillation? | IBM
What is Knowledge distillation? | IBM
ibm.com
Apr 16, 2024
Top videos
How to Distill LLM? LLM Distilling [Explained] Step-by-Step using Python Hugging Face AutoTrain
12:09
How to Distill LLM? LLM Distilling [Explained] Step-by-Step using Python Hugging Face AutoTrain
YouTubeFreeBirds Crew - Data
6.7K viewsFeb 28, 2025
What is LLM Distillation ?
6:05
What is LLM Distillation ?
YouTubeNew Machina
30.4K viewsFeb 2, 2025
Knowledge Distillation Simplified | Teacher to Student Model for LLMs (Step-by-Step with Demo) #ai
29:14
Knowledge Distillation Simplified | Teacher to Student Model for LLMs (Step-by-Step with Demo) #ai
YouTubeUnfold Data Science
1.4K views6 months ago
Knowledge Distillation Applications
Distillation - Definition, Detailed Process, Types, Uses
Distillation - Definition, Detailed Process, Types, Uses
byjus.com
Jun 2, 2016
201 reactions · 41 shares | Microsoft and CMU researchers have begun to unravel three mysteries in deep learning related to ensemble, knowledge distillation, and self-distillation. Discover how their work has led to the first theoretical proof with empirical evidence for ensemble in deep learning: https://aka.ms/AAavuq3 | Microsoft Research | Facebook
0:28
201 reactions · 41 shares | Microsoft and CMU researchers have begun to unravel three mysteries in deep learning related to ensemble, knowledge distillation, and self-distillation. Discover how their work has led to the first theoretical proof with empirical evidence for ensemble in deep learning: https://aka.ms/AAavuq3 | Microsoft Research | Facebook
FacebookMicrosoft Research
14K views2 weeks ago
Knowledge Distillation as Semiparametric Inference [Talk]
50:39
Knowledge Distillation as Semiparametric Inference [Talk]
Microsoft
Apr 28, 2021
How to Distill LLM? LLM Distilling [Explained] Step-by-Step using Python Hugging Face AutoTrain
12:09
How to Distill LLM? LLM Distilling [Explained] Step-by-Step using Py…
6.7K viewsFeb 28, 2025
YouTubeFreeBirds Crew - Data Science and GenAI
What is LLM Distillation ?
6:05
What is LLM Distillation ?
30.4K viewsFeb 2, 2025
YouTubeNew Machina
Knowledge Distillation Simplified | Teacher to Student Model for LLMs (Step-by-Step with Demo) #ai
29:14
Knowledge Distillation Simplified | Teacher to Student Model for LLM…
1.4K views6 months ago
YouTubeUnfold Data Science
MedAI #88: Distilling Step-by-Step! Outperforming LLMs with Smaller Model Sizes | Cheng-Yu Hsieh
57:22
MedAI #88: Distilling Step-by-Step! Outperforming LLMs with Smaller …
8.7K viewsJul 20, 2023
YouTubeStanford MedAI
Master the Art of Model Compression with Knowledge Distillation | Future of Model Deployment
23:18
Master the Art of Model Compression with Knowledge Dist…
1.7K viewsAug 24, 2023
YouTubeDataTrek
Better not Bigger: Distilling LLMs into Specialized Models
16:49
Better not Bigger: Distilling LLMs into Specialized Models
11.7K viewsOct 30, 2023
YouTubeSnorkel AI
Knowledge Distillation in Machine Learning: Full Tutorial with Code
24:11
Knowledge Distillation in Machine Learning: Full Tutorial with Code
3.1K views10 months ago
YouTubeMLWorks
9:51
Knowledge Distillation in Deep Learning - Basics
24.2K viewsSep 11, 2021
YouTubeDingu Sagar
25:21
Model Distillation: Same LLM Power but 3240x Smaller
22.4K viewsAug 5, 2024
YouTubeAdam Lucek
43:49
MiniLLM: Knowledge Distillation of Large Language Models
6.9K viewsJul 23, 2023
YouTubeGabriel Mongaras
4:19
AI model distillation
17.8K viewsFeb 19, 2025
YouTubeInterSystems Developers
4:17
Distillation Column Modeling in MATLAB and Simulink
22.5K viewsDec 5, 2012
YouTubeAPMonitor.com
5:49
What is Transfer Learning? An Introduction.
1.8K viewsJan 8, 2025
YouTubeDon Woodlock
57:02
Model Distillation: From Large Models to Efficient Enterprise Sol…
2.3K viewsOct 1, 2024
YouTubeSnorkel AI
7:56
How Distillation Makes AI Models Smaller and Cheaper
43 views5 months ago
YouTubePop Culture Files
1:28
DeepSeek and OpenAI: Understanding Model Distillation
15.7K viewsJan 30, 2025
TikTokmor10web
4:25
Distillation | Definition, Process & Types
30K viewsMar 2, 2016
Study.comRoger Harris
16:54
Knowledge Distillation - Keras Code Examples
8.6K viewsFeb 28, 2021
YouTubeConnor Shorten
3:45
What is Transfer Learning? How Is It Different from Model Distillation?
4 views6 months ago
YouTubeAllow AI
2:18
How to setup a basic Distillation Column (DISTL model) Aspen Plu…
1.9K viewsFeb 27, 2018
YouTubeChemical Engineering Guy
45:46
Model Mondays - Fine Tuning & Distillation
1.1K views7 months ago
YouTubeMicrosoft Reactor
13:01
Teacher-Student Neural Networks: The Secret to Supercharged AI
7.2K viewsSep 11, 2023
YouTubeComputing For All
4:53
AI Distillation: Making Models Smaller and More Affordable
3 views5 months ago
YouTubeTrendTrove
23:48
Knowledge Distillation Demystified: Techniques and Applications
2.8K viewsOct 3, 2024
YouTubeSnorkel AI
15:33
Distillation Column Simulation with Aspen Hysys
26.9K viewsSep 16, 2019
YouTubeAspen Hysys Pro
1:17:18
How to model Distillation Columns in Aspen Hysys
9.2K viewsAug 9, 2023
YouTubeHotSpot
3:02
Set up of a Distillation Column Model RadFrac in Aspen Plus (Le…
21.5K viewsFeb 27, 2018
YouTubeChemical Engineering Guy
7:21
Knowledge Distillation in Deep Learning - DistilBERT Explained
19.3K viewsSep 22, 2021
YouTubeDingu Sagar
36:45
ASTM D-86 Distillation Demonstration
19K viewsSep 9, 2017
YouTubeAndy
See more videos
Static thumbnail place holder