AI Marketplace: Serving Environment for AI Solutions Using Kubernetes

Recent advances in the field of artificial intelligence (AI) provide numerous potentials for industrial compa- nies. However, the adoption of AI in practice is still left behind. One of the main reasons is a lack of knowledge about possible AI application areas by industry experts. The AI Marketplace addresses this problem by pro- viding a platform for the cooperation between industry experts and AI developers. An essential function of this platform is a serving environment that allows AI developers to present their solution to industry experts. The solutions are packaged in a uniform way and made accessible to all platform members via the serving environment. In this paper, we present the conceptual design of this environment, its implementation using Amazon Web Services, and illustrate its application on two exemplary use cases.