Prof. Dr.

Hauswirth, Manfred

Filters

1 1
Reset filters

Settings
Now showing 1 - 2 of 2
  • Publication
    VisionKG: Unleashing the Power of Visual Datasets via Knowledge Graph
    ( 2023-09)
    Yuan, Jicheng
    ;
    Le-Tuan, Anh
    ;
    Nguyen-Duc, Manh
    ;
    Tran, Trung-Kien
    ;
    Hauswirth, Manfred
    ;
    Phuoc, Danh Le
    The availability of vast amounts of visual data with heterogeneous features is a key factor for developing, testing, and benchmarking of new computer vision (CV) algorithms and architectures. Most visual datasets are created and curated for specific tasks or with limited image data distribution for very specific situations, and there is no unified approach to manage and access them across diverse sources, tasks, and taxonomies. This not only creates unnecessary overheads when building robust visual recognition systems, but also introduces biases into learning systems and limits the capabilities of data-centric AI. To address these problems, we propose the Vision Knowledge Graph (VisionKG), a novel resource that interlinks, organizes and manages visual datasets via knowledge graphs and Semantic Web technologies. It can serve as a unified framework facilitating simple access and querying of state-of-the-art visual datasets, regardless of their heterogeneous formats and taxonomies. One of the key differences between our approach and existing methods is that ours is knowledge-based rather than metadatabased. It enhances the enrichment of the semantics at both image and instance levels and offers various data retrieval and exploratory services via SPARQL. VisionKG currently contains 519 million RDF triples that describe approximately 40 million entities, and are accessible at https://vision.semkg.org and through APIs. With the integration of 30 datasets and four popular CV tasks, we demonstrate its usefulness across various scenarios when working with CV pipelines.
  • Publication
    CQELS 2.0: Towards a unified framework for semantic stream fusion
    ( 2022)
    Le-Tuan, Anh
    ;
    Nguyen-Duc, Manh
    ;
    Le, Chien-Quang
    ;
    Tran, Trung-Kien
    ;
    Hauswirth, Manfred
    ;
    Eiter, Thomas
    ;
    Phuoc, Danh Le
    We present CQELS 2.0, the second version of Continuous Query Evaluation over Linked Streams. CQELS 2.0 is a platform-agnostic federated execution framework towards semantic stream fusion. In this version, we introduce a novel neuralsymbolic stream reasoning component that enables specifying deep neural network (DNN) based data fusion pipelines via logic rules with learnable probabilistic degrees as weights. As a platform-agnostic framework, CQELS 2.0 can be implemented for devices with different hardware architectures (from embedded devices to cloud infrastructures). Moreover, this version also includes an adaptive federator that allows CQELS instances on different nodes in a network to coordinate their resources to distribute processing pipelines by delegating partial workloads to their peers via subscribing continuous queries.