• English
  • Deutsch
  • Log In
    Password Login
    Research Outputs
    Fundings & Projects
    Researchers
    Institutes
    Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Anderes
  4. Beyond patent citations: a benchmark for detecting implicit science–technology linkages using open large language models
 
  • Details
  • Full
Options
2026
Paper (Preprint, Research Paper, Review Paper, White Paper, etc.)
Title

Beyond patent citations: a benchmark for detecting implicit science–technology linkages using open large language models

Title Supplement
Preprint published on Research Square, Version 1, posted 04 June, 2026
Abstract
Science–technology linkage (STL) analysis relies predominantly on patent citations to scientific literature, an indicator known to underestimate actual knowledge interactions. Computational alternatives exist but have not been systematically compared, and whether links detected beyond citations represent genuine intellectual relationships remains unestablished. This study addresses both questions through a multi-paradigm benchmark in wind energy (3,611 patents, 43,582 publications, 350 citation-verified ground-truth links). Five retrieval methods are evaluated: lexical (TF-IDF, BM25), BERT-era embeddings (MiniLM), and modern dense embeddings (mxbai-embed, nomic-embed). A validation stage employing two open-weight generative LLMs as independent judges assesses the top embedding-detected implicit links. Results show that methods with comparable aggregate recall identify largely non-overlapping link subsets (pairwise Jaccard < 6%), that a widely used general-purpose sentence encoder significantly underperforms all alternatives including a lexical baseline, and that 81% of top implicit links receive dual-model validation as meaningful patent–publication relationships, substantially exceeding random same-domain controls. All models are open-weight, offering a reproducible two-stage pipeline for detecting citation-invisible science–technology interactions.
Author(s)
Darold, Denilton Luiz  orcid-logo
Fraunhofer-Institut für System- und Innovationsforschung ISI  
Open Access
File(s)
Download (689.2 KB)
Rights
CC BY 4.0: Creative Commons Attribution
DOI
10.21203/rs.3.rs-9589637/v1
10.24406/publica-9195
Additional link
Full text
Language
English
Fraunhofer-Institut für System- und Innovationsforschung ISI  
Keyword(s)
  • science–technology linkage

  • large language models

  • patent analysis

  • scientometrics

  • LLM-as-judge

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Contact
© 2024