MLINFO COLLECTION

RAG

検索拡張生成、文書検索、社内ナレッジQAに関係する論文・実装をまとめます。

記事一覧

21 / 37
arxiv

Context Compaction for World Models

World models let observers explore and interact with generated worlds. Recent work shows that when observers revisit a region, current models often fail to regenerate it consistently.

nlp
arxiv

Contextual Embeddings Beyond the Gold Chunk

Contextual embeddings represent chunks of a document with respect to the document's global context. These models are typically trained and evaluated under the assumption that a relevant document…

nlp
arxiv

Geometry Matters in Packed 3D Attention

Packing a 3D volume into a token sequence is not merely long-sequence modeling. Once the volume is packed, sequence order no longer encodes the geometry of the sample---so a positional mechanism…

nlp