MLINFO COLLECTION

深層学習

記事一覧

30 / 45
arxiv

Looped Uniform Diffusion Language Models

Uniform diffusion language models (UDLMs) generate text by iteratively denoising sequences of ordinary vocabulary tokens, any of which may be corrupted and subsequently revised. During training,…

deep-learning
arxiv

Mitigating Model Collapse through Dreaming Learning

Training generative models on synthetic data causes loss of diversity and a decrease in performance, a phenomenon known as model collapse. We study this degeneration spectrally in a controlled Markov…

deep-learning
arxiv

Nashtopes and their A-discriminants

An $n$-player game in normal form is said to be of format $\boldsymbol{d} = (d_1, \dots, d_n)$ if the $i$-th player has $d_i$ options for $1 \le i \le n$, and is said to be balanced if $d_n - 1 \le…

deep-learning
arxiv

Stochastic Nonlinearities Improve Uncertainty Estimation

Reliable uncertainty estimation is important across visual recognition tasks, providing information about the confidence and reliability of model predictions. Many uncertainty estimation methods…

deep-learning
arxiv

Asymmetric Likelihood-Free Hypothesis Testing

In likelihood-free hypothesis testing (LFHT), given samples from two unknown distributions $P,Q$ on $[n]$ with $\mathrm{d_{TV}}(P,Q)\geq\varepsilon$, and from a third distribution $D\in\{P,Q\}$, the…

deep-learning
arxiv

Where Do LLMs Learn to Recommend AI?

Asked what to study, which career to pursue, or what product to build, large language models (LLMs) often recommend AI-related options. We ask where this tendency comes from by comparing models…

deep-learning