Jie Jin

Enhancing Pedestrian Interaction in Public Spaces: Integrating Geo-located AR Technology with Street Performance

This research investigates how augmented reality (AR) can enhance public spaces by transforming pedestrian interaction, specifically through integrating AR with street performances. By merging live performances with digital elements, the study aims to create engaging and immersive experiences that connect people more deeply with urban environments and with one another. The project focuses on developing an AR application that uses advanced location-based technologies like SLAM (Simultaneous Localization and Mapping) and VPS (Visual Positioning System) to accurately anchor AR content in real-world spaces. This allows digital effects to interact seamlessly with the surroundings, adapting to live performances in real time. A key feature of the application is its ability to visualize sound, converting the music and audio from street performers into dynamic visual effects that enhance both the performance and the surrounding space. Additionally, the research employs machine learning to recognize street performers and tailor AR effects to their movements and actions. This personalizes the interaction, creating a more engaging experience for both the audience and the performer. The system also enables users to interact with past performances, offering a new layer of engagement that extends beyond the present moment. By integrating AR into public spaces, this research highlights how technology can activate and enrich urban areas, fostering greater social interaction and cultural engagement. The goal is to show how AR can turn ordinary public spaces into interactive environments that not only entertain but also preserve cultural expressions and encourage community participation. This project ultimately aims to contribute to the future of urban design by offering innovative ways to engage with and revitalize city spaces.

Supervisors

Professor Andre Brown & Tane Moleta

Qualifications

Master of Architecture (Professional Degree) , The University of Melbourne, Australia
Bachelor of Architecture, Hebei University of Technology, China

Contact

jie.jin@vuw.ac.nz

Jie Jin Portfolio Design

LinkedIn