As users walked through the Connected Health space, the gadgets followed, continually updating their content.

I built the gadget in TouchDesigner; it’s design involved matching to creative intent: building dynamic animations, curves, and state-based triggers. The result is a series of tightly integrated and highly adjustable animation systems, linked to input triggers and timing parameters.

I worked closely with team member Lucas Morgan to engineer the body tracking solution. To track users properly in the space, we re-oriented the original 3D point cloud, which was captured at a 3/4 angle, to a full top-down / overhead view.

We generated a black and white video feed from the 3D data, which was then tracked in 2D (blob tracking). The output was then post-processed to account for holding user ids and generating accurate timing for presence detection.

In a short few weeks, we went from concept to “dry fit” at our AV integrators facility.

After a client review and sign-off, ali equipment was shipped to Las Vegas, assembled, and the system underwent a series of on-site calibrations and adjustments.

I researched several hardware technology options, settling on RFID as the core tech for the experience.

I used Arduino-based hardware, and coded a state machine in C++. I developed an interactive media player in TouchDesigner. I created an RFID reader and translator, tying product IDs to a configurable JSON product catalog.

The experience featured 5 physical zones, 9 displays, and 24 products.

I worked closely with the product design team, AV integrators, and booth fabricators to craft the final physical aspects of the experience. I delivered CAD for RFID reader mountings, and specified zone tolerances.

The final experience featured Abbott Labs products embedded in lucite casings with invisible RFID tags. When placed in a target zone, each product triggered an audio-visual interaction specific to that product.

Over the course of the CES event, hundreds of guests visited the booth, guided by a team of docents.