• English
  • Deutsch
  • Log In
    Password Login
    Research Outputs
    Fundings & Projects
    Researchers
    Institutes
    Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Konferenzschrift
  4. Overview of the SV-Ident 2022 shared task on survey variable identification in social science publications
 
  • Details
  • Full
Options
2022
Conference Paper
Title

Overview of the SV-Ident 2022 shared task on survey variable identification in social science publications

Abstract
In this paper, we provide an overview of the SVIdent shared task as part of the 3rd Workshop on Scholarly Document Processing (SDP) at COLING 2022. In the shared task, participants were provided with a sentence and a vocabulary of variables, and asked to identify which variables, if any, are mentioned in individual sentences from scholarly documents in full text. Two teams made a total of 9 submissions to the shared task leaderboard. While none of the teams improve on the baseline systems, we still draw insights from their submissions. Furthermore, we provide a detailed evaluation. Data and baselines for our shared task are freely available at https://github.com/vadis-project/sv-ident.
Author(s)
Tsereteli, Tornike
Universität Mannheim, Data and Web Science Group
Kartal, Yavuz Selim
GESIS - Leibniz-Institut für Sozialwissenschaften, Mannheim
Ponzetto, Simone Paola
Universität Mannheim, Data and Web Science Group
Zielinski, Andrea  orcid-logo
Fraunhofer-Institut für System- und Innovationsforschung ISI  
Eckert, Kai
Hochschule der Medien -HdM-, Stuttgart  
Mayr, Philipp
GESIS - Leibniz-Institut für Sozialwissenschaften, Mannheim
Mainwork
Third Workshop on Scholarly Document Processing 2022  
Conference
Workshop on Scholarly Document Processing 2022  
International Conference on Computational Linguistics 2022  
Open Access
File(s)
Download (505.21 KB)
Rights
CC BY 4.0: Creative Commons Attribution
DOI
10.24406/h-428015
Language
English
Fraunhofer-Institut für System- und Innovationsforschung ISI  
Keyword(s)
  • Survey variable detection

  • Machine learning

  • Semantic textual similarity

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Contact
© 2024