MLINFO COLLECTION

新着記事

日次更新の新着・公開記事を新しい順に掲載しています。

記事一覧

58 / 125
arxiv

Reliable AI-Assisted Decisions via Selective Auditing

We consider online monitoring of an AI system that produces a sequence of decisions. At each round, the system outputs a proposed decision together with a confidence score estimating the…

deep-learning
arxiv

Low-Bit N-Gram Embeddings for Language Models

Many recent open-weight language models use n-gram embedding tables to improve performance. These tables store learned representations of short token sequences, such as pairs or triples of…

deep-learning
arxiv

A Fix for Softmax and Cross-Entropy

Standard implementations of softmax, log-softmax, and cross-entropy have two numerical bugs. The first bug, Softmax Collapse, rounds the target logit's gradient to zero if that one logit is much…

deep-learning