• English
  • Deutsch
  • Log In
    Password Login
    Research Outputs
    Fundings & Projects
    Researchers
    Institutes
    Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Konferenzschrift
  4. Detecting Audio-Text Decontextualization through Entailment and Semantic Analysis
 
  • Details
  • Full
Options
June 15, 2026
Conference Paper
Title

Detecting Audio-Text Decontextualization through Entailment and Semantic Analysis

Abstract
Audio-text decontextualization is a form of real-world misinformation in which genuine audio recordings - speech excerpts, news clips, interviews - are detached from their authentic context and paired with misleading textual narratives. Addressing it in practice requires both audio provenance analysis and context analysis: provenance retrieves candidate source recordings, while context analysis determines whether the recovered source supports the narrative attached to the post. This paper presents three context-analysis pipelines able to address this issue and their cascade combinations, and evaluates them on the M3A dataset alongside four audio-language baselines. We show that a substantial fraction of M3A manipulations are fundamentally undetectable from audio-text content alone, and that on the subset where detection is possible our best pipelines reach 0.73 accuracy on Named Entity Manipulation (NEM) and 0.92 on Multimodal Misalignment (MM) audio swap. Building on these findings, we formulate an operational workflow for real-world investigations and demonstrate it on three case studies, which also motivate a lightweight linguistic middle layer for conditional and modal/hedging framing drops. This leads to two practical deployment recommendations: (1) a fast bulk-screening pipeline that flags context-stripping attacks via entailment failure; and (2) a large language model (LLM)-based deep-verification pipeline for the most suspicious cases, capable of explicit reasoning about framing shifts.
Author(s)
Gerhardt, Milica  
Fraunhofer-Institut für Digitale Medientechnologie IDMT  
Cuccovillo, Luca  
Fraunhofer-Institut für Digitale Medientechnologie IDMT  
Aichroth, Patrick  
Fraunhofer-Institut für Digitale Medientechnologie IDMT  
Mainwork
MAD 2026, 5th ACM International Workshop on Multimedia AI against Disinformation. Proceedings  
Conference
International Workshop on Multimedia AI against Disinformation 2026  
Open Access
File(s)
Download (821.15 KB)
Rights
CC BY 4.0: Creative Commons Attribution
DOI
10.1145/3810988.3812666
10.24406/publica-9138
Additional link
Full text
Language
English
Fraunhofer-Institut für Digitale Medientechnologie IDMT  
Keyword(s)
  • Media Forensics

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Contact
© 2024