All Projects
3D
Events
Games
Illustrations
Installations
Client Work
About
Artist CV
Creative Technologist
October 2024
Client: Google | Agency: Chemistry Creative
project details are confidential and adapted for portfolio use.
Commissioned by a Google (major tech client) through creative agency Chemistry Creative, this immersive installation merged hardware, AI, and real-time data to deliver a personalized book recommendation experience. I co-developed the technical systems that powered the core interaction from RFID-based user recognition to AI-driven content generation while working in close collaboration with another creative technologist and Chemistry Creative’s in-house design and fabrication team.
Key Technical Contributions:
-
RFID Integration:
Programmed a custom RFID scanner system using Arduino to assign unique user IDs and trigger individualized interactions. This data drove both the AI logic and projected visual content across the experience.
-
System Architecture & Networking:
Built the system’s backend to coordinate communication between the RFID scanner, two retrofitted phones, and a large-format projection display. Used TCP/IP networking for real-time data transfer, and adapted the system on-site to wired Ethernet for stability.
-
AI Integration & Book Recommendation Logic:
Collaboratively implemented an AI pipeline that:
- Identified user-named books via API cross-referencing
- Confirmed and clarified input with the user
- Generated relevant, personalized recommendations
- Delivered author, title, description, and visual metadata to the projection layer
-
Page Tracking with Computer Vision:
Designed a page-tracking system using reflective stickers and a night-vision camera to detect book interactions. This data dynamically updated visual projections mapped onto a large-scale physical book.
-
Phone Integration (Supporting):
Integrated an Arduino-based switch to detect handset lift/hang-up, triggering stages of the experience and syncing with the phone’s scripted interaction logic.
Collaboration & Execution:
- Worked side-by-side with a co-creative technologist who focused on the phone’s interactive script, AI dialogue logic and book projection visuals.
- Chemistry Creative’s internal team designed and fabricated the physical environment, including phone booths and a sculptural display housing the projection system.
Delivered a robust, multi-modal interaction that tied together physical gesture, voice input, and algorithmic response. The final installation was part of a high-profile activation and succeeded in blending analog and digital interaction into an imaginative user experience.