For the Machine Learning week at CIID, we were asked to devise an interactive experience that reacts to the user/environment using ML techniques. There was a further limit placed on us that the installation had to be COVID friendly. We iterated on several ideas that could use pose or human detection. We wanted to avoid the user removing their mask or touching any surfaces.

To that end, we came up with the idea for Stretch!

Stretch! is an interactive playful installation that can be placed into any street, corridor or an empty wall. It’s a way to provide a moment of respite for adults and kids alike.

With the help of coco-ssd, an object detection machine learning model, we identify people in front of a camera and translate them into cute stretchable rectangles! These rectangle avatars change and move as you move and change your “shape” in the play area. 

Stretch is an audiovisual installation - it encourages people to change their shape to get specific reactions from the stretchy rectangles. We’ve seen people crouch down into small sizes and stretch their bodies as much as they could!