• English
  • Deutsch
  • Log In
    Password Login
    Research Outputs
    Fundings & Projects
    Researchers
    Institutes
    Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Artikel
  4. Platforms and Infrastructure to Operate GenAI in Your Company's Basement
 
  • Details
  • Full
Options
July 23, 2024
Journal Article
Title

Platforms and Infrastructure to Operate GenAI in Your Company's Basement

Abstract
In recent years, generative AI has revolutionized various industries by enabling the creation of highly sophisticated and creative outputs. However, the journey to harnessing the full potential of generative AI has just begun, especially for organizations opting to self-host these solutions. Unlike in the case where cloud resources from OpenAI, Microsoft Azure or their competitors are used, self-hosting requires extensive computational power, substantial data storage, and robust infrastructure - but also offers tempting benefits like data privacy and cost efficiency. In this article we discuss self-hosting of generative AI and report on the technical and operational hurdles involved. Additionally, we will provide detailed information on how we have built our own platform for multi-modal foundation models, offering insights into the necessary steps and considerations for successful implementation.
Author(s)
Wegener, Dennis  orcid-logo
Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS  
Stein, Benny Jörg  orcid-logo
Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS  
Journal
Survey of Tools for Secure Infrastructures and Processes  
Link
Link
Language
English
Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS  
Keyword(s)
  • Infrastructure

  • Generative AI

  • Platforms

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Contact
© 2024