MLINFO COLLECTION

自然言語処理

記事一覧

3 / 44
arxiv

Training Foundation Models with a Single Algorithm

Foundation models are typically trained in stages: pretraining, midtraining, supervised fine-tuning (SFT), and reinforcement learning (RL), with changes in both data and learning algorithms. We show…

nlp
arxiv

Algebraic World Model: From Exploration to Proofs

AI has made remarkable progress in mathematics, solving challenging problems with machine-checkable proofs in Lean, yet typically relying on predefined mathematical definitions and formal…

nlp
arxiv

Framework-Conditional Open Materials Generation

Theoretical predictions of novel materials rely on a variety of techniques, from data-mining-based ion substitution methods to fully de novo generative models. Each approach imposes specific…

nlp
arxiv実装リンクあり

SCARL: Sequence Confidence-Aligned Reinforcement Learning

Reinforcement learning with verifiable rewards (RLVR) improves language-model reasoning by scoring sampled responses with a rule-based verifier and reinforcing those that pass. Where a classifier's…

nlp
arxiv

Understanding and Mitigating Role Spoofing in LLMs

Despite growing capabilities, LLMs remain susceptible to prompt injections: malicious inputs that can manipulate or hijack models. In particular, it has recently been observed that LLMs can exhibit…

nlp