Experiential Design / Final Project - Completed Experience

7th July 2025 - 27th July 2025 (Week 12 - Week 14)

Sin Jun Ming 0364638

Experiential Design / Bachelor of Design in Creative Media / Taylor's University

Final Project - Completed Experience



Instructions

Final Project - Completed Experience

Instruction:

Students will synthesise the knowledge gained in task 1, 2 and 3 for application in task 4. Students will create integrate visual asset and refine the prototype into a complete working and functional product experience.

Requirements: 
  1. Project file and Folders
  2. Application installation files (APK for android, iOS Build Folder for IOS/iPhones)

Submission: 

  1. Online posts in your E-portfolio as your reflective studies
  2. Video walkthrough (Presentation)

1. Songs Update

After consulting with Mr. Razif in Week 14, I decided to replace Kendrick Lamar’s DAMN. album due to its non child-friendly content. I’ve now switched to "Love in My Pocket" by Rich Brian and "I Ain’t Worried" by OneRepublic, both more suitable and upbeat for a wider audience. This change shifts the tone of the project while keeping the AR interactions engaging and fun.

Fig 1.1 New Song - "I Ain't Worried" by One Republic

Fig 1.2 New Song - "Love in My Pocket" by Rich Brian

2. Overall Modification of AR Tunes

  • Lyrics Sync

I implemented a script that syncs lyrics with the song playback. When the user clicks the "Show Lyrics" button, the lyrics appear line by line on the panel in time with the music. This adds a more interactive and engaging experience for the user.

Fig 2.1 Lyrics Sync Script

Lyrics panel is shown when "Show lyrics" button is clicked.

Fig 2.2 Instruction Panel

  • Adding 3D model
To enhance the experience, I added a 3D model with a singing animation from the Unity Asset Store. This model helps bring the music to life visually, making the AR scene more dynamic and immersive.

Fig 2.3 3D model with Singing Animation

  • Filter Feature
The filter feature was handled by my partner, Hanson. He implemented a variety of visual filters such as neon, warm, and romantic to match different moods of the songs. These filters enhance the atmosphere and give users more personalized visual experiences.


3. Final Submission

Google Drive link: https://drive.google.com/drive/folders/1HhcWChzmjKh8Pij1zbBGKZGE9Z3ZezCg?usp=sharing

Walkthrough Video link: https://youtu.be/JIOuFXRcKUQ

Presentation Video link: https://youtu.be/1PTwGtYt13E




Reflection

This project has been a valuable learning experience, filled with both creative challenges and technical growth. Initially, I planned to use Kendrick Lamar’s DAMN. album, but after consulting with Mr. Razif in Week 14, I realized the content wasn’t appropriate for all audiences. I made the decision to switch to more lighthearted and suitable tracks, “Love in My Pocket” and “I Ain’t Worried”. This shift helped redefine the project’s tone and opened up new creative possibilities, especially in terms of visuals and interactivity.

One of the key features I developed was the lyrics sync system. I wrote a script that displays lyrics in real-time as the song plays, triggered when the user clicks a “Show Lyrics” button. This added a functional and engaging element to the experience, allowing users to visually follow the song. I also integrated a 3D singing model from the Unity Asset Store to enhance the immersive feel, creating a more dynamic and performance-like environment within the AR space.

This project was a team effort, and I’m especially grateful for my partner Hanson’s contribution. He handled the filter feature, applying different visual styles like neon, warm, and romantic tones to match the mood of each song. His work added an aesthetic layer that made the experience feel more polished and customizable. Overall, this project has strengthened my skills in Unity, collaboration, and user-focused design. I’m proud of the final outcome and how we overcame each challenge to create an interactive and enjoyable AR music experience.


Comments