MLINFO COLLECTION

自然言語処理

記事一覧

28 / 44
huggingface

Your Benchmark Is an Empirical Measure Over Difficulty

A benchmark is not merely a collection of test questions; it naturally induces an empirical measure over difficulty. In this work, we develop this measure-based view of benchmark evaluation.

nlp
huggingface

TraceForge: Distilling with Your Own Thinking

Using an LLM to generate training data for another is among the most general ways to train one, and it remains common practice. Some frontier teams have closed that route for their own models: what…

nlp
huggingface

T-DIG: Text-Conditioned Diversity for Image Generation

Text-to-image (T2I) platforms typically return several images per prompt so users can explore different visual interpretations and choose one that matches their intent. However, T2I models are…

nlp
arxiv

PLE: Physical-Engineering's Last Exam

Frontier language models now score above 90% on popular knowledge benchmarks and are increasingly deployed as agents that carry out multi-hour professional work. Yet no existing benchmark tests…

nlp
arxiv

Rethinking the Evaluation of LLM Fact-Checkers

Large language models (LLMs) are widely used to answer factual questions, but their answers can contain errors and must be fact-checked claim by claim. Yet the resulting score depends on three design…

nlp