MLINFO COLLECTION

深層学習

記事一覧

14 / 45
arxiv

LinMix: Data Mixing as Linear Domain Attribution

Language model performance depends strongly on the mixture of domains in the pretraining data corpus. Popular data mixing methods select these domain weights by training many small proxy models on…

deep-learning
arxiv

Watermark Basins: Black-Box Detection of Distilled LLMs

Proprietary language models and their reasoning traces are vulnerable to API-based distillation, where an adversary trains a student model on the teacher model's outputs. To obtain evidence of…

deep-learning