deep-learningarxiv

MQAScore: Fine-Grained Text-Music Alignment Evaluation via Large Audio Language Model

Text-to-music alignment is commonly evaluated by the global similarity between text and audio embeddings, which collapses all described attributes into a single score and obscures which ones are…

Wei-Jaw Lee / Chun-Ping Wang / Xuanjun Chen / Yi-Hsuan Yang

用途
原典で確認
難易度の目安
Hard
実装コストの目安
High

概要

Text-to-music alignment is commonly evaluated by the global similarity between text and audio embeddings, which collapses all described attributes into a single score and obscures which ones are missing. We instead introduce MQAScore, which verifies each atomic musical concept along five clip-level dimensions (genre, instrument, mood/theme, vocal, and usage) by the probability that a large audio language model (LALM) answers affirmatively to a binary question. To assess evaluator reliability, we construct verification labels from presence/absence annotations and LLM-guided concept substitutions, and propose the Sensitivity-Invariance Ratio, which measures how selectively an evaluator responds to meaning-changing substitutions. Experiments show that concept-level scoring improves both question-answering and similarity-based evaluators, and MQAScore can be a more reliable and interpretable fine-grained complement to global similarity for evaluating text-to-music alignment.

参考リンク

リンク先のライセンス・再現性・データ条件をご確認ください。自動分類や実装の目安は保証ではありません。

実装を始めるプロンプト

参考リンクを確認したうえで、次の内容をコピーして利用できます。

# 論文・記事
MQAScore: Fine-Grained Text-Music Alignment Evaluation via Large Audio Language Model

# 概要
Text-to-music alignment is commonly evaluated by the global similarity between text and audio embeddings, which collapses all described attributes into a single score and obscures which ones are…

# 原典
https://arxiv.org/abs/2610.31083

上記の手法を実装してください。実行前に依存関係とライセンスを確認してください。

関連する記事