• English
  • Deutsch
  • Log In
    Password Login
    Research Outputs
    Fundings & Projects
    Researchers
    Institutes
    Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Scopus
  4. Fraunhofer SIT at CheckThat! 2025: Multi-Instance Evidence Pooling for Numerical Claim Verification
 
  • Details
  • Full
Options
2025
Conference Paper
Title

Fraunhofer SIT at CheckThat! 2025: Multi-Instance Evidence Pooling for Numerical Claim Verification

Abstract
The growing spread of misinformation, particularly on social media, has increased the demand for scalable and accurate automated fact-checking systems. This paper presents our approach to Task 3 of the CheckThat! 2025 lab, which focuses on the verification of numerical claims. We propose a three-stage architecture comprising (i) semantic evidence retrieval using dense bi-encoder representations stored in a FAISS index, (ii) contrastive re-ranking with a fine-tuned cross-encoder leveraging weak supervision from gold evidences, and (iii) claim classification using multi-instance learning (MIL) with various evidence pooling strategies. Experiments on the QuanTemp dataset demonstrate that attention and LogSumExp pooling outperform standard concatenation methods, with our best model achieving a macro-F1 score of 0.5213 on the test set. Additionally, ablation studies confirm the effectiveness of contrastive re-ranking and the practical advantages of dense retrieval, which achieves both higher accuracy and significantly faster retrieval than traditional BM25.
Author(s)
Runewicz, André
Fraunhofer-Institut für Sichere Informationstechnologie SIT  
Ranly, Paul
Fraunhofer-Institut für Sichere Informationstechnologie SIT  
Vogel, Inna
Advisori FTC GmbH
Steinebach, Martin  
Fraunhofer-Institut für Sichere Informationstechnologie SIT  
Mainwork
Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2025)  
Conference
Conference and Labs of the Evaluation Forum 2025  
File(s)
Download (1.17 MB)
Rights
CC BY 4.0: Creative Commons Attribution
DOI
10.24406/publica-5950
Language
English
Fraunhofer-Institut für Sichere Informationstechnologie SIT  
Keyword(s)
  • Claim verification

  • Contrastive learning

  • Cross-encoder re-ranking

  • Dense retrieval

  • Fact-checking

  • Misinformation detection

  • Multi-instance learning

  • Natural language processing

  • Numerical claims

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Contact
© 2024