MLINFO COLLECTION

深層学習

記事一覧

9 / 45
huggingface実装リンクあり

Multi-Token Prediction Done Right

Multi-Token Prediction (MTP) is now a common ingredient in language-model pre-training, as it improves downstream performance and enables faster inference through speculative decoding. We identify a…

deep-learning