Sniff is an interactive projection in a storefront window. As the viewer walks by the projection a dog follows him, dynamically responds to his gestures and changes his behavior based on the state of engagement with the viewer.
2009. Artist: Karolina Sobecka, Technical Direction: James George
Sniff is created with Unity Game Engine which renders the dog in real time and allows to dynamically change his behavior based on the video tracking data. The sidewalk is illuminated with infrared lights and an infrared-sensitive camera that is used to monitor the motion in front of the display windows.
The position of each viewer is tracked with an application built in openFrameworks. A gesture recognition system interprets fast, big actions as threatening. Slow actions directed at the dog (for example hand extended in his direction) are interpreted as friendly. The dog keeps track of the attitude of the viewer and forms a relationship with them over time based on the history of interaction.
Sniff production was supported by a Finishing Funds grant from the Experimental Television Center. The Experimental Television Center’s Finishing Funds program is supported by the Electronic Media and Film Program at the New York State Council on the Arts.