MLINFO COLLECTION

新着記事

日次更新の新着・公開記事を新しい順に掲載しています。

記事一覧

7 / 125
arxiv

Training Foundation Models with a Single Algorithm

Foundation models are typically trained in stages: pretraining, midtraining, supervised fine-tuning (SFT), and reinforcement learning (RL), with changes in both data and learning algorithms. We show…

nlp
arxiv

Efficient Scalable Oversight via Rewinding

Scalable oversight asks how a weak verifier can check the outputs of computations performed by more powerful AI systems. One proposed approach uses relativizing interactive proofs, in which a weak…

deep-learning