Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
MiniLLM (MiniLLM)
[go: Go Back, main page]
Hugging Face's logo
Activity Feed

AI & ML interests

Training efficient language models (MiniLLM, MiniPLM)

Organization Card
Community About org cards

Training Small Language Models with Knowledge Distillation

Official pre-trained models and baselines in

  • MiniLLM: Knowledge distillation of LLMs during instruction tuning.
  • MiniPLM: Knowledge distillation of LLMs during pre-training.

Collections 2