MLINFO COLLECTION

RAG

検索拡張生成、文書検索、社内ナレッジQAに関係する論文・実装をまとめます。

記事一覧

13 / 37
arxiv

Affine-invariant Cubic Newton with Weak Learners

Modern gradient boosting algorithms are based on Newton's method, which excels empirically but lacks global convergence guarantees. While recent work on Gradient-Regularized Newton (GRN) boosting…

nlp
arxiv

CulturalRiddles: A Multicultural Benchmark of Riddles

As LLMs expand their language coverage, evaluating how well they understand and represent diverse cultures becomes increasingly important. However, many benchmarks remain English-centric, with…

nlp
arxiv

Formal Specifications with Data-Driven Signal Analysis

Developing analog and hybrid systems requires substantial domain knowledge that is hard to articulate in a formal specification; without additional effort, this domain knowledge is also inaccessible…

computer-vision
arxiv

Random Jump Forests

Random jump forests are introduced as a nonparametric tool for estimating conditional cumulative transition rates and occupation probabilities in multi-state models. The main idea is that a single…

nlp
arxiv

Empirical concentration for chains with infinite memory

Concentration inequalities for time series usually involve unknown quantities measuring dependence. This prevents their direct use as confidence bounds, or as criteria for learning algorithms.

deep-learning
arxiv

Low-Bit N-Gram Embeddings for Language Models

Many recent open-weight language models use n-gram embedding tables to improve performance. These tables store learned representations of short token sequences, such as pairs or triples of…

deep-learning