Google




Featured



All Projects



3D

Events

Games

Illustrations

Installations

Client Work



About

Artist CV

Instagram

Email
Interactive Book Recommendation System

Creative Technologist

October 2024

Client: Google | Agency: Chemistry Creative

project details are confidential and adapted for portfolio use.

Commissioned by a Google (major tech client) through creative agency Chemistry Creative, this immersive installation merged hardware, AI, and real-time data to deliver a personalized book recommendation experience. I co-developed the technical systems that powered the core interaction from RFID-based user recognition to AI-driven content generation while working in close collaboration with another creative technologist and Chemistry Creative’s in-house design and fabrication team.

Key Technical Contributions:


  • RFID Integration:

    Programmed a custom RFID scanner system using Arduino to assign unique user IDs and trigger individualized interactions. This data drove both the AI logic and projected visual content across the experience.

  • System Architecture & Networking:

    Built the system’s backend to coordinate communication between the RFID scanner, two retrofitted phones, and a large-format projection display. Used TCP/IP networking for real-time data transfer, and adapted the system on-site to wired Ethernet for stability.

  • AI Integration & Book Recommendation Logic:

    Collaboratively implemented an AI pipeline that:
    • Identified user-named books via API cross-referencing
    • Confirmed and clarified input with the user
    • Generated relevant, personalized recommendations
    • Delivered author, title, description, and visual metadata to the projection layer

  • Page Tracking with Computer Vision:

    Designed a page-tracking system using reflective stickers and a night-vision camera to detect book interactions. This data dynamically updated visual projections mapped onto a large-scale physical book.

  • Phone Integration (Supporting):

    Integrated an Arduino-based switch to detect handset lift/hang-up, triggering stages of the experience and syncing with the phone’s scripted interaction logic.

Collaboration & Execution:

  • Worked side-by-side with a co-creative technologist who focused on the phone’s interactive script, AI dialogue logic and book projection visuals.
  • Chemistry Creative’s internal team designed and fabricated the physical environment, including phone booths and a sculptural display housing the projection system.

Delivered a robust, multi-modal interaction that tied together physical gesture, voice input, and algorithmic response. The final installation was part of a high-profile activation and succeeded in blending analog and digital interaction into an imaginative user experience.