敘事落差:大型語言模型能否協助我們跨越語言導航多元敘事?
The Narrative Gap: Can LLMs Help Us Navigate Diverse Narratives Across Languages?
研究速讀
作者提出六項跨語言多元資訊尋求能力,並以涵蓋23種出版語言、23個爭議主題、1,333篇新聞與460條Reddit查詢的NarrativeBench,評估24種查詢語言下的14個大型語言模型。作者指出,現有模型難以可靠呈現與保留相互競爭的敘事,即使使用者明確要求多元觀點,仍可能出現資訊落差與語言過濾氣泡。
值得留意
- 作者定義六項能力,涵蓋敘事納入、敘事排除、缺失敘事辨識,以及呈現多元敘事、在確認性查詢下維持敘事覆蓋、跨語言資訊對等。
- NarrativeBench包含23種出版語言、23個爭議主題的1,333篇新聞文章,以及460條源自Reddit的查詢。
- 作者評估14個模型、24種查詢語言後表示,模型在呈現與保留多元敘事方面仍有明顯不足。
閱讀限制
僅依標題與摘要整理,未閱讀全文,因此無法核實基準建構細節、評估方法、模型清單與結果數據,也無法確認是否經過同儕審查。
原始摘要 [EN]
Large language models (LLMs) increasingly mediate how people seek and consume information, including accounts that differ across languages and regions, especially on contested topics. Supporting diverse information seeking requires models to help users navigate competing narratives across languages and information streams. We define six capabilities necessary for diverse multilingual information seeking: three foundational capabilities for narrative inclusion, narrative exclusion, and missing narrative identification; and three higher-level capabilities for presenting diverse narratives, preserving narrative coverage under confirmatory queries, and maintaining information parity across languages. To guide the development of those information seeking capabilities, we introduce NarrativeBench, a benchmark comprising 1,333 news articles in 23 publication languages across 23 contested topics and 460 Reddit-grounded queries. Evaluating 14 LLMs across 24 query languages, we find that current models lack the capabilities needed to reliably navigate diverse narratives, limiting users' control over the perspectives they receive and leaving substantial gaps in exposure to competing accounts even when diversity is explicitly requested. Information access also differs across query framings and languages, risking echo chambers, linguistic filter bubbles, and information disparities that weaken the common ground needed for democratic discourse. NarrativeBench provides a foundation for developing information systems that give users across languages and regions agency to navigate diverse narratives.
AI 摘要僅根據公開標題與摘要整理;研究結論來自作者,請以原文為準。