Cross Sensory Co-Design Tools and Interaction Qualities

What is the temperature of a loud cry? What is the color of a hand-clap? Cross-sensory and multi-modal interactions offer interesting possibilities in terms of inputs and outputs that might be leveraged for affective and emotional purposes. However, it is hard to design such interactions without the right co-design tools. We developed such tools in the last 10 years: the Loaded Dice and the Wheel of Plush. Both devices incorporate a multitude of sensors and actuators to demonstrate interactions and aid in co-design workshops. The tools incorporate the principle of technical synesthesia: the ability to map any of the included sensors to any of the included actuators. With intuitive simple interaction schemes it is possible to easily and effortlessly create new combinations. We discuss the core principles of the tools and how we realized a meaningful mapping between sensors and actuators. We further discuss how we use the tools for exploration, sensory sketching or scenario driven ideation, and where we see additional potential.