Compressing AI Models (LLMs) using Distillation, Quantization, and Pruning
1:12
YouTubeRajistics - data science, AI, and machine learning
Compressing AI Models (LLMs) using Distillation, Quantization, and Pruning
A couple of techniques we use to compress models. This saves GPU memory and can reduce the amount of compute needed. Model distillation compresses a large model’s knowledge into a smaller one, quantization reduces memory usage by representing parameters with fewer bits, and pruning streamlines the model by removing less important weights ...
2.8K viewsFeb 2, 2025
Knowledge Distillation Tutorial
Understanding Knowledge Distillation in Neural Sequence Generation - Microsoft Research
1:18:05
Understanding Knowledge Distillation in Neural Sequence Generation - Microsoft Research
Microsoft
Jan 17, 2020
Knowledge Distillation: Principles, Algorithms, Applications
Knowledge Distillation: Principles, Algorithms, Applications
neptune.ai
Jul 22, 2022
What is Knowledge distillation? | IBM
What is Knowledge distillation? | IBM
ibm.com
Apr 16, 2024
Top videos
Knowledge Distillation Simplified | Teacher to Student Model for LLMs (Step-by-Step with Demo) #ai
29:14
Knowledge Distillation Simplified | Teacher to Student Model for LLMs (Step-by-Step with Demo) #ai
YouTubeUnfold Data Science
1.4K views6 months ago
Distillation Column Simulation with Aspen Hysys
15:33
Distillation Column Simulation with Aspen Hysys
YouTubeAspen Hysys Pro
26.9K viewsSep 16, 2019
MedAI #88: Distilling Step-by-Step! Outperforming LLMs with Smaller Model Sizes | Cheng-Yu Hsieh
57:22
MedAI #88: Distilling Step-by-Step! Outperforming LLMs with Smaller Model Sizes | Cheng-Yu Hsieh
YouTubeStanford MedAI
8.7K viewsJul 20, 2023
Knowledge Distillation Applications
201 reactions · 41 shares | Microsoft and CMU researchers have begun to unravel three mysteries in deep learning related to ensemble, knowledge distillation, and self-distillation. Discover how their work has led to the first theoretical proof with empirical evidence for ensemble in deep learning: https://aka.ms/AAavuq3 | Microsoft Research | Facebook
0:28
201 reactions · 41 shares | Microsoft and CMU researchers have begun to unravel three mysteries in deep learning related to ensemble, knowledge distillation, and self-distillation. Discover how their work has led to the first theoretical proof with empirical evidence for ensemble in deep learning: https://aka.ms/AAavuq3 | Microsoft Research | Facebook
FacebookMicrosoft Research
14K views2 weeks ago
Knowledge Distillation as Semiparametric Inference [Talk]
50:39
Knowledge Distillation as Semiparametric Inference [Talk]
Microsoft
Apr 28, 2021
What is Knowledge Distillation?
1:00
What is Knowledge Distillation?
YouTubeData Science Made Easy
2 months ago
Knowledge Distillation Simplified | Teacher to Student Model for LLMs (Step-by-Step with Demo) #ai
29:14
Knowledge Distillation Simplified | Teacher to Student Model for LLM…
1.4K views6 months ago
YouTubeUnfold Data Science
Distillation Column Simulation with Aspen Hysys
15:33
Distillation Column Simulation with Aspen Hysys
26.9K viewsSep 16, 2019
YouTubeAspen Hysys Pro
MedAI #88: Distilling Step-by-Step! Outperforming LLMs with Smaller Model Sizes | Cheng-Yu Hsieh
57:22
MedAI #88: Distilling Step-by-Step! Outperforming LLMs with Smaller …
8.7K viewsJul 20, 2023
YouTubeStanford MedAI
Knowledge Distillation in Machine Learning: Full Tutorial with Code
24:11
Knowledge Distillation in Machine Learning: Full Tutorial with Code
3.1K views10 months ago
YouTubeMLWorks
What is LLM Distillation ?
6:05
What is LLM Distillation ?
30.4K viewsFeb 2, 2025
YouTubeNew Machina
Distillation Column Modeling in MATLAB and Simulink
4:17
Distillation Column Modeling in MATLAB and Simulink
22.5K viewsDec 5, 2012
YouTubeAPMonitor.com
Better not Bigger: Distilling LLMs into Specialized Models
16:49
Better not Bigger: Distilling LLMs into Specialized Models
11.7K viewsOct 30, 2023
YouTubeSnorkel AI
2:18
How to setup a basic Distillation Column (DISTL model) Aspen Plu…
1.9K viewsFeb 27, 2018
YouTubeChemical Engineering Guy
1:17:18
How to model Distillation Columns in Aspen Hysys
9.2K viewsAug 9, 2023
YouTubeHotSpot
26:42
How to model Distillation Columns in Aspen Hysys II
2.5K viewsAug 23, 2023
YouTubeHotSpot
12:09
How to Distill LLM? LLM Distilling [Explained] Step-by-Step using Py…
6.7K viewsFeb 28, 2025
YouTubeFreeBirds Crew - Data Science and GenAI
2:16
Multistage Distillation Column Demonstration
16.5K viewsDec 26, 2016
YouTubeAIChE Academy
25:21
Model Distillation: Same LLM Power but 3240x Smaller
22.4K viewsAug 5, 2024
YouTubeAdam Lucek
57:02
Model Distillation: From Large Models to Efficient Enterprise Sol…
2.3K viewsOct 1, 2024
YouTubeSnorkel AI
36:45
ASTM D-86 Distillation Demonstration
19K viewsSep 9, 2017
YouTubeAndy
3:55
The principle and how to work simple distillation process Animat…
30.4K viewsJan 17, 2020
YouTubeBYD Channel
43:49
MiniLLM: Knowledge Distillation of Large Language Models
6.9K viewsJul 23, 2023
YouTubeGabriel Mongaras
7:20
Lab demonstration distillation process
24.3K viewsNov 12, 2014
YouTubeMastermind Studios
9:51
Knowledge Distillation in Deep Learning - Basics
24.2K viewsSep 11, 2021
YouTubeDingu Sagar
14:59
Simulation of Complex Distillation Column || Aspen HYSYS
5.1K viewsMay 31, 2020
YouTubeChemiopedia
4:19
AI model distillation
17.8K viewsFeb 19, 2025
YouTubeInterSystems Developers
0:58
Simple Distillation Animation
105.4K viewsJun 15, 2018
YouTubeChemistryConnected
4:25
Multi-stage Batch Distillation (Interactive Simulation)
4.3K viewsJun 16, 2021
YouTubeLearnChemE
3:02
Set up of a Distillation Column Model RadFrac in Aspen Plus (Le…
21.5K viewsFeb 27, 2018
YouTubeChemical Engineering Guy
23:18
Master the Art of Model Compression with Knowledge Dist…
1.7K viewsAug 24, 2023
YouTubeDataTrek
18:08
Multi Effect Distillation (MEDpf) Matlab/Simulink Model Run
7.5K viewsMar 7, 2018
YouTubeREDS Library
7:56
How Distillation Makes AI Models Smaller and Cheaper
43 views5 months ago
YouTubePop Culture Files
4:00
How to Set-up and Perform a Simple Distillation
86.4K viewsSep 18, 2014
YouTubeSupreme Science
4:25
Distillation | Definition, Process & Types
30K viewsMar 2, 2016
Study.comRoger Harris
See more videos
Static thumbnail place holder