MLINFO COLLECTION

自然言語処理

記事一覧

17 / 44
huggingface

The Lexical Imprint of Pre-training Data

How much of zero-shot benchmark accuracy is captured by word-level alignment between a pre-training corpus and the benchmark target? We study this question through word-level unigram cross-entropy…

nlp