2024 Frameless XR Showcase

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060)

• Ryan Tapping, Lecturer, Physics, Cornell University
• Phil Krasicky, Senior Lecturer, Physics, Cornell University
• Suryash Malviya ’26, Physics and Astronomy & Computer Science, Ithaca College
• James Spinazzola, Barbara & Richard T. Silver ‘50, MD ‘53 Associate Professor in Music, Director of Winds, Cornell University
• Ksenia Ionova, Senior Instructional Designer, Center for Teaching Innovation, Cornell University (kbi4@cornell.edu)
• Becky Lane, Associate Director of Learning Technologies, Center for Teaching Innovation, Cornell University

Creative Technology Lab at the Center for Teaching Innovation, Cornell University, shares two applications created in collaboration with Cornell faculty and students to foster learning goals in STEM and Humanities. First, the 3D Electromagnetic Simulation will include two models, Magnetic Flux and Gaussian Surface. We share how using these models has been improving student understanding of the 3D-based concepts in a 500+ large-enrollment course. Second is the VR app for learning Conducting. It includes a series of VR learning modules designed by Professor James Spinazzola to foster student learning outside of class. Topics include the beat plane, traditional beat patterns, various conducting styles, and more generally, the development of a comprehensive vocabulary of gestures for conducting.

Watch 3D and Virtual Reality for Learning in STEM and Humanities video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060)

• Erfan Farhadi, Computer Science Department, University of Rochester (efarhadi@ur.rochester.edu)
• Alishba Gul, Computer Science Department, University of Rochester
• Wenxing Wang, Computer Science Department, University of Rochester

Discover SnaX-Ray Cart Dash, an augmented reality game that turns kids into "shopper helpers"! Visitors will scan grocery items to learn about nutrition and help virtual customers with unique dietary needs, all while navigating fun challenges and receiving instant feedback from our SnaX-Ray Checkpoints. Join us to explore healthy eating in a playful, interactive way!

Watch AR food recommender (SnaX-Ray Cart Dash) video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060)

Mary Ann Mavrinac Studio X at the University of Rochester

• Liz Hogrefe (lizkhogrefe@gmail.com)
• Meg Moody
• Fenway Powers
• Josh Jones
• Gayatri Shetty
• Emily Lin
• Richard Chuong
• Sherkeem Duprey
• Caleb Kohn-Blank

Aurum VR is an alchemical laboratory, based on a real 17th-century text in the University of Rochester’s Rossell Hope Robbins Library. The user is able to conduct experiments, use and learn about historical artifacts, and interact with texts from the Robbins Library in a space that exhibits alchemical history from across the globe.

Watch Aurum VR video >

Location: MAGIC 1st Floor Atrium

Abhishek Kumar Dash, Department of Computer Science, Rochester Institute of Technology (ad3862@rit.edu)

A VR experience that immerses the player in various unsettling liminal spaces between worlds, evoking the eerie sensation of being trapped in limbo.

Watch Caligo: Liminal Spaces video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060)

• Elouise Oyzon, School of Interactive Games and Media, Rochester Institute of Technology (eroics@rit.edu)
• John Wager, School of Interactive Games and Media, Rochester Institute of Technology

ChangelingVR is a virtual reality first-person interactive mystery founded upon the ideas of magical realism and a sense of unease and wonder. You play as detective Aurelia Walker, a private eye gifted with the unique ability to dream-walk, allowing her to see the thoughts and memories of anyone she touches. This gift leads the Summers-Manalo family to hire you, their last resort in discovering what is wrong with their baby. As you make contact with the mother, the father, and their two kids, you must use your mystical powers, as well as your skills of deduction, to enter their minds and make your way through their manifested hopes and fears to save the young child.

Watch Changeling VR video >

Location: MAGIC 1st Floor Atrium

• Zihan Wang, Department of Computer Science, Rochester Institute of Technology (zw9095@rit.edu)
• Aubrey Marcsisin, Department of Computer Science, Rochester Institute of Technology

Visitors will see their facial expressions mirrored in real time on two different avatars —one that is cartoonish avatar and another with a more realistic design, allowing for a highly responsive and natural interaction. They will have the chance to explore methods of minimizing the uncanny valley effect by experimenting facial tracking and avatar design.

Watch Counteracting the Uncanny Valley: Real-Time Facial Motion Capture with Cartoon and Realistic Avatars video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).   Note that there are 2 separate play areas on the soundstage floor.

• AJ Biswas, School of Interactive Games and Media, Rochester Institute of Technology
• Annie Zhang, School of Interactive Games and Media, Rochester Institute of Technology
• Noya Cai, School of Interactive Games and Media, Rochester Institute of Technology  (qc6338@rit.edu)
• Tsingtao Zhang, School of Interactive Games and Media, Rochester Institute of Technology
• Urvashi Dhingra, School of Interactive Games and Media, Rochester Institute of Technology

In this Virtual Reality experience, a teleportation experiment gone horribly awry maroons a scientist and an engineer in an unknown world, thus they must traverse ancient architecture using wit, teamwork, and a portal bridging mirrored realities to find their way home. 

See Duolatera video >

Location: MAGIC Demo Room (MSS-2170)

• Gregory Ojiem, Department of Computer Science, Rochester Institute of Technology (gro3228@rit.edu)
• Xing Weilin, Department of Computer Science, Rochester Institute of Technology

"Exploring Lighting in AR" showcases how we can make augmented reality more realistic and seamlessly integrated with the world around us. Our demonstration will feature virtual objects that dynamically respond and change in response to various real-world lighting conditions.

Watch Exploring Lighting in AR video >

Location: MAGIC 2nd Floor Lobby

MAGIC Spell Studios Rochester Institute of Technology -- Finger Lakes Visitors Connection

• contact: Diane Linnet (dxlmss@rit.edu)

Finger Lakes Virtual Museum (FLVM) is an interactive experience showcasing the rich history and cultural heritage of Ontario County, NY. Explore local history via AR and multimedia content— brought to the public as QR code installations spanning across 70+ locations throughout 16 towns and 2 cities.

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

• Aidan Weigel, University of Rochester
• Elma Hsieh, University of Rochester
• Nathan Hadjiyski, University of Rochester (nhadjiys@u.rochester.edu)
• Sana Tahir, University of Rochester

We will exhibit our concept's demo, which is a vr application that allows users to create music by hitting floating spheres, including piano, drums, and guitar. The idea is to expand the project to many different genres, but the current demo includes a basic lofi demonstration

Watch Harmonia video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

• Susan Lakin, School of Photographic Arts & Sciences, Rochester Institute of Technology (srlpph@rit.edu)
• Tom Dooley, School of Communication, Rochester Institute of Technology

IDEA 150 is an Introduction to Augmented Reality course for students in the College of Art and Design (CAD) and College of Liberal Arts (CLA). The course gives students an opportunity to try out a variety of platforms and tools, and learn about the many use cases for AR in industries such as advertising, journalism, art, design, marketing, and communication. The course is designed to be accessible to students without coding skills. This exhibit showcases current students works-in-progress.

Watch IDEA 150: Intro to AR - Student Works-In-Progress video >

Location: MAGIC 1st Floor Atrium

• Ziming Li, School of Information, Rochester Institute of Technology (zl1398@rit.edu)
• Roshan Peiris, School of Information, Rochester Institute of Technology

We developed a large model language-driven agent for virtual reality that not only responds to player conversations and actions but also actively engages with the surrounding virtual environment. The agent can initiate conversations and perform actions, creating immersive role-play scenarios such as guiding players through a virtual gallery as a tour guide.

Watch Interactive Environment-Aware LLM-Driven VR Agent video >

Location: MAGIC 1st Floor Atrium

• Xin Yu Jiang, Department of Computer Science, Rochester Institute of Technology (xyj5094@rit.edu)
• Kelly Feke, Department of Computer Science, Rochester Institute of Technology
• Jingyi He, Department of Computer Science, Rochester Institute of Technology

Walk around frameless accompanied by a mobile AR magical cat. If you find special markers around Frameless, the cat may do a cute animation!

Location: MAGIC 1st Floor Atrium

• Siena Mollerstuen, Brain and Cognitive Sciences, University of Rochester
• Nishant Dinesha, Neuroscience, University of Rochester Medical Center
• Emily Knight,Pediatrics and Neuroscience, University of Rochester Medical Center (EmilyJ_Knight@urmc.rochester.edu)
• Duje Tadin, Brain and Cognitive Sciences, , University of Rochester

Participants will have the opportunity to try a high resolution simulation of Kodak Hall and participate in an ~2 minute task where they rate the perceived order of an auditory and visual stimulus within the virtual symphony hall. This task will provide some simple feedback on how they tend to integrate weight visual and auditory information

Watch Naturalistic Audiovisual Integration in VR Kodak Hall video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

• Shutong Wu, University of Rochester
• Zhen Zhang, University of Rochester (zzh131@u.rochester.edu)
• Ryan Zhao, University of Rochester

We will be exhibiting PetMoment, a VR-based virtual pet avatar designed to enhance communication and interaction within virtual meetings. Powered by AI, the pet avatar can observe and assist in group dynamics, helping to mediate conversations and improve meeting productivity through gentle cues and engagement.

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

• James Spann, Computer Science Department, University of Rochester (jspann2@cs.rochester.edu)
• Zhen Bai, Computer Science Department, University of Rochester

We present tool to assist hearing parents in using American Sign Language (ASL) with their deaf and hard of hearing (DHH) children. This is useful for the 90% of DHH children who are born to hearing parents and need a focused system to get a handle on ASL with a family member at home.

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

VR/AR Club

• Susan Lakin
• Daniel Siuffe (das4511@rit.edu)
• Niko Huber
• David Holt
• Cade Gilbert

We will be exhibiting the VR Club and a few of the ongoing projects. This includes the Hardlight haptic vest project, the EyetrackVR project, and the ISS onboard experience.

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

Cedric Bone, Golisano College of Computing and Information Sciences, Rochester Institute of Technology (cb9017@rit.edu)

In this interactive demo, participants will use hand tracking with the Meta Quest 3 headset to engage with a virtual shelf of objects and ask an AI questions about the environment.

Watch Shelf of Stuff video >

Location: MAGIC Demo Room (MSS-2170)

Charles Hacker, Department of Computer Science, Rochester Institute of Technology (crh1987@rit.edu)

An augmented reality simulation using the passthrough technology of the Oculus Quest 3 intended to help guide new diabetes patients and address needle anxiety with virtual exposure therapy.

Watch Simulating and guiding virtual diabetic insulin injections using augmented reality video >

Location: MAGIC 1st Floor Atrium

Gabriel J Diaz, Center for Imaging Science, Rochester Institute of Technology (gabriel.diaz@rit.edu)

We have created a novel graphical shader that, when viewed with one eye, appears to be nothing but randomly blinking dots like static on an old television screen. However, when viewed with two eyes, hidden shapes will pop out of the noise. This is a demonstration of our first step towards the development of a tool for the rehabilitation of poor stereo vision in adults following disrupted development due to amblyopia or strabismus - an issue that affects 5-7% of adults.

Watch Stereogram Space video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

• Miles Vilke, University of Rochester Libraries (mvilke@u.rochester.edu)
• Libby Braun,University of Rochester Libraries

Studio Xplorer is an educational VR project created by staff and students at the Mary Ann Mavrinac Studio X, an XR program and space at the University of Rochester Libraries. Studio Xplorer started as part of an undergraduate fellowship project and features a digital twin of Studio X’s physical space. The application introduces users to XR, Studio X, and how to use the headset through a playful escape room experience.

Watch Studio Xplorer video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

Brandy Freitas, syGlass, RIT Alum '08

Every day, research scientists across the globe are capturing breathtaking 3D image datasets, revealing the stunning intricacies of biological structures that most people never get to see. At syGlass, thanks to recent advancements in "direct volume rendering" and virtual reality (VR), we can finally go beyond the limits of traditional screens and truly unlock the beauty and complexity that’s hidden within these data. Come experience how VR technology is transforming the way we view, share, and appreciate science.

Watch syGlass: Unlocking the Hidden Beauty of Science with Virtual Reality and Direct Volume Rendering video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

Ian McDermott, Immersive Media Design Department, University of Maryland (imcdermo@umd.edu)

Inside Outside is a volumetric music video by artist Ian McDermott and Washington D.C. band, The North Country. Unlike most VR music videos which tend to limit degrees of freedom, Inside Outside was shot with a depth camera and is experienced as a moving point cloud in VR, allowing the viewer full freedom to move where they choose.

Watch The North Country - Inside Outside video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

• B. Hanel, Faculty of Engineering, McGill University ( blaise.hanel@mcgill.ca )
• Nasim Razavina, Faculty of Engineering, McGill University

This experience is virtual recreation of a guided tour of a mineral processor in Rouyn-Noranda, Quebec. The VR tour focuses on safety training, and is designed for Mining and Materials Science students planning on going on co-op at a mineral processor.

Watch Virtual Exploration of Mineral Processing Plant video >

Location: MAGIC Sound Stage (MSS-2020 / MSS-2060).

• Zakilya Brown, Brain and Cognitive Sciences, University of Rochester
• Sarah Mehta, Cell and Developmental Biology, University of Rochester
• Nishant Dinesha, Neuroscience, University of Rochester Medical Center
• Emily Knight, Pediatrics and Neuroscience, University of Rochester Medical Center (EmilyJ_Knight@urmc.rochester.edu)

We have a paradigm that we designed which integrates VR and EEG to study spatial attention and audiovisual processing of speech in noisy settings. Users will have the opportunity to engage in a shortened version of the VR task (without EEG) and receive feedback on their accuracy in the ability to process speech in the setting of noise.

Watch VR-EEG investigation of Auditory Processing Disorder in children with autism and ADHD video >

Location: stairwell between the 2nd and 3rd floor of MAGIC

XRLive Project Team, Rochester Institute of Technology:

• Pravina Narendra Bhalerao, Department of Computer Science, Rochester Institute of Technology
• Sol Kumar, , Department of Computer Science, Rochester Institute of Technology
• Brandon Riley, New Media Design,Rochester Institute of Technology
• Jason Salazar Tobar, School of Individualized Studies, Rochester Institute of Technology
• Joe Geigel, Department of Computer Science, Rochester Institute of Technology (Joe.Geigel@rit.edu)

We are using TouchDesigner to detect motion of a person and have it interact with a particle system that is displayed on the stairwell walls of MAGIC. As the person moves their hands on the wall, their movement will affect the particle system displayed. This is a teaser Demo/WIP for a dance performance in the spring where dancers are going to have snow particles coming out of their hands depending on movements.

Watch XRLive: Let It Snow video >

XRLive Project Team, Rochester Institute of Technology:

• Marc Browning, Department of Computer Science, Rochester Institute of Technology
• Benson Haley, Department of Computer Science, Rochester Institute of Technology
• Zhen Lai, School of Film and Animation, Rochester Institute of Technology
• Aubrey Marcsisin, Department of Computer Science, Rochester Institute of Technology
• Kyle Morais, Department of Software Engineering, Rochester Institute of Technology
• Phillip Napoli, Department of Computer Science, Rochester Institute of Technology
• Lily Ready, School of Interactive Games and Media,Rochester Institute of Technology
• Hridiza Roy, School of Individualized Studies / Dept of Computer Science, Rochester Institute of Technology
• Anishya Thinesh, Department of Computer Science, Rochester Institute of Technology
• Nick Will, New Media Design, Rochester Institute of Technology
• Joe Geigel, Department of Computer Science, Rochester Institute of Technology (Joe.Geigel@rit.edu)

Performers:

• Lane Biddle, National Technical Institute for the Deaf, Rochester Institute of Technology
• Rafa Davis, School of Interactive Games and Media, Rochester Institute of Technology
• Morgan Lecrone, School of Film and Animation, Rochester Institute of Technology

In this short performance, we will demonstrate the latest in the use of facial and body motion capture to drive avatars in a shared virtual space. The performance will present a number of small skits, performed live across campus yet experienced by audience members in the MAGIC space.

Watch XRLive: Virtual Theatre Sampler video >