Computing Ph.D. Student Leads Groundbreaking Research with KAIST Interaction Lab

In an exciting development from the Niantic x RIT Geo Games and Media Lab, Jiangnan Xu, a Computing and Information Sciences Ph.D. student, will begin a nine-month research journey to Korea in collaboration with the KAIST Interaction Lab (kixLab), housed at the prestigious Korea Advanced Institute of Science & Technology.

Sponsored by Korea Telecom, the largest telecommunications company in Korea, the focus of Jiangnan’s research revolves around the intersection of artificial intelligence (AI) and the metaverse to bridge the gap between the real and virtual worlds.

A key aspect of this research involves the development of AI Non-Player Characters (NPCs) that leverage large language models to assume roles within various scenarios. These AI NPCs are designed to interact based on user inputs dynamically, creating personalized and evolving narrative experiences.

The Genieverse platform, developed by Korea Telecom, is at the core of Jiangnan’s research. This platform offers users a wide array of AI-based content, allowing users to customize avatars, and spaces, and engage in real-time communication within the virtual world. Notably, the "AI Home Twin" feature utilizes AI space modeling technology to replicate users' real homes in the metaverse. With over 1,000 items for decoration and customization, Genieverse distinguishes itself by focusing on intimate interactions with personally invited friends, fostering a more shared and personal experience compared to other metaverse platforms.

“This collaboration signifies more than just a milestone for Jiangnan;” said assistant professor in the School of Interactive Games and Media and Lab Director, Konstantinos Papangelis, “it underscores the global reach and defined strengths of our lab as one of the world leaders in this space”.