Being Strong Progressively! Enhancing Knowledge Distillation of Large
Language Models through a Curriculum Learning Framework
Lingyuan Liu, Mengxiang Zhang
Paper
Details
#ProgressiveStrength #KnowledgeDistillation #LargeLanguageModels