nlparxiv

OSynth: A Longitudinal, Context-Sensitive Evaluation of Meeting Understanding

Meeting notetakers are increasingly deployed in settings where longitudinal context is available including calendar metadata, prior meetings, emails, slides, and speaker enrollments; however, meeting…

Ian Porada / Suraj Tripathi / Chaitanya Animesh / Leda Sari / Chaitanya Narisetty

用途
原典で確認
難易度の目安
Hard
実装コストの目安
High

概要

Meeting notetakers are increasingly deployed in settings where longitudinal context is available including calendar metadata, prior meetings, emails, slides, and speaker enrollments; however, meeting corpora remain limited in terms of size, domain coverage, and available context. We present OSynth, a large-scale synthetic dataset of simulated organizations comprising 570 hours of meeting audio together with associated artifacts and a latent ground-truth state. In a pairwise comparison, human raters distinguish OSynth meetings from real meeting transcripts with only 56% accuracy based on excerpts of 150-300 words. Across state-of-the-art LLMs, additional context yields significant gains on several entity-sensitive dimensions, demonstrating limitations of contemporary approaches and the potential usefulness of OSynth in developing better-contextualized meeting-understanding systems.

参考リンク

リンク先のライセンス・再現性・データ条件をご確認ください。自動分類や実装の目安は保証ではありません。

実装を始めるプロンプト

参考リンクを確認したうえで、次の内容をコピーして利用できます。

# 論文・記事
OSynth: A Longitudinal, Context-Sensitive Evaluation of Meeting Understanding

# 概要
Meeting notetakers are increasingly deployed in settings where longitudinal context is available including calendar metadata, prior meetings, emails, slides, and speaker enrollments; however, meeting…

# 原典
https://arxiv.org/abs/2610.29319

上記の手法を実装してください。実行前に依存関係とライセンスを確認してください。

関連する記事