MLINFO COLLECTION

LLM Fine-tuning

LoRA、RLHF、SFT、軽量ファインチューニングなど、LLMを用途に合わせる技術を扱います。

記事一覧

5 / 36
huggingface

A Broader Look into MLLM's Retrieval Heads

Locating relevant evidence in long inputs is a core capability of Multimodal Large Language Models. Prior studies attribute this capability to retrieval heads, a sparse set of attention heads that…

nlp
huggingface

TraceForge: Distilling with Your Own Thinking

Using an LLM to generate training data for another is among the most general ways to train one, and it remains common practice. Some frontier teams have closed that route for their own models: what…

nlp
huggingface

Focused Omni-Modal GUI Agents

Graphical User Interface (GUI) agents increasingly act over streaming omni-modal observations spanning screenshots, audio, video, interaction history, and device states. However, exposing this…

deep-learning
github実装リンクあり

MiniOneRec — Minimal reproduction of OneRec

(この項は、MiniOneRec — Minimal reproduction of OneRecのリポジトリで説明しているため、このリポジトリは削除しました)

モデル再現
huggingface

ReGE: Stronger Agents through Experience Synthesis

Repeated attempts at interactive tasks uncover facts, useful operations, and failures that can inform subsequent execution. We introduce ReGE, a framework for turning this recorded experience into…

nlp