Generative Multimodal Content Creation with Location-Aware Context for Gamified Mobile Assisted Language Learning Apps Using Large Language Models

The integration of digital technologies in language learning has transformed traditional paradigms, allowing for unprecedented flex-ibility and accessibility. Specifically, trends in Artificial Intelligence (AI) and Large Language Models (LLMs) offer great potential to generate multimodal content, for example, for Mobile-Assisted Language Learn-ing (MALL) apps. However, it remains challenging to create content that is also compelling to users, including personalized aspects. This paper presents PlacePhrase, a gamified MALL application that lever-ages context-aware, generative content creation to enhance the learning experience. By utilizing LLM assistants and location-based data, Pla-cePhrase facilitates dynamic learning tasks, interactive conversations, and immersive exploration, addressing the limitations of current MALL applications. Our user study evaluated the app’s usability, the quality of generated content, and the effectiveness of gamification elements. Results indicate a generally positive perception of the app, with participants appreciating the personalized and contextually relevant tasks, while also highlighting areas for improvement in immersion and flow experience. This research contributes to the ongoing exploration of AI-driven lan-guage learning tools and underscores the importance of integrating spa-tial context to create more engaging educational experiences.