Services
Web AR Dev, FE Dev
Client
The Coca-Cola Company × Star Wars
Year
2025
Links
https://www.coca-cola.com/us/en/offerings/star-wars
The Story
Coca-Cola and Star Wars joined forces to create a groundbreaking augmented reality experience that let fans become part of the galaxy far, far away. Users could record personalized video messages that were seamlessly mapped onto iconic Star Wars character holograms, complete with custom skin tone matching and authentic audio effects.
As one of the developers on this project, I built critical features that brought the vision to life, from implementing face mesh to video synchronization and skin tone detection to optimizing hologram stability and creating a seamless share experience. My work ensured that every fan could see themselves as a character in the Star Wars universe with smooth animations, synchronized audio, and intuitive interactions.
This experience was developed for The Coca-Cola Company in partnership with Star Wars throughout 2025. Built with WebAR technology using 8th Wall, A-Frame, and TypeScript, my work included face mesh synchronization, real-time skin tone matching with custom shaders, hologram animation systems, audio-video synchronization, gesture interactions, native sharing integration, performance optimization for low-bandwidth users, and QR code scanning for product collectibles.
The Concept
The technical execution focused on immersion, personalization, and reliability. The hologram pipeline was optimized to eliminate distortion, flickering, and T-pose issues on slow connections. Audio-video synchronization ensured complete message playback without cutoffs. Interaction features included one-finger rotation, tap-to-place, and recenter functionality. The audio system layered character voices, background music, and effects while respecting global mute preferences. The sharing flow combined canvas-based GIF generation with native APIs and unique URL tracking. Performance optimizations maintained quality even at 3-4 Mbps, creating a magical AR experience that let millions of fans see themselves as Star Wars holograms.
The Brief
Create an interactive AR experience where user-recorded videos become Star Wars character holograms in the real world. The system needed intelligent skin tone matching for diverse characters, stable hologram rendering synchronized with audio, intuitive gesture controls for placement and rotation, 3-second GIF export capabilities, native mobile sharing with tracking URLs, QR code scanning for Coca-Cola collectibles, comprehensive audio management, and reliable performance across varying network conditions.
