AudioPint

The AudioPint vision is to build a portable, durable, and inexpensive sound synthesis and effects system that is based completely on free open-source software, is flexibly reconfigurable and easy to use, and that is capable of accepting a diverse range of input devices for control purposes. AudioPint supports expressivity and experimentation with new forms of sound control.We expect tomorrow's musicians to be using tomorrow's instruments, and to an increasing extent, these instruments can be tools of their own design.

Augmented Mirror

The goal of this project is to provide an intuitive interface to give users insight into their daily activity patterns. Using a display embedded in a mirror, data from wearable sensors can be visualized into a familiar routine context. We put an emphasis on how to display such data in a subtle way so that it is non-intrusive and maintains the mirror's original purpose.

We are investigating several applications of the technology, including communication with mobile phones to collect behaviour data, face recognition to identify members of a family as well as clothing store application instant messaging application. .

Embodied Emergence

Embodied Emergence explores how simple localized interactions between elements of a system can sometime result in unexpected complex patterns.

The work consists of a set of small tangible nodes that alter their behavior according to the nearby nodes, in an asynchronous fashion. Nodes have magnets on the bottom and are deployed on a flat metallic surface. Each node is equipped with a small speaker that generates a musical tone according to the state of its immediate neighbors and a simple set of rules. Nodes also provide visual feedback on their current state by means of colored lighting. Finally, the nodes sense touch through a thin metal rim and can toggle their state to reflect the interventions of viewers.

The nodes are fully independent from one another. Users can reconfigure the topology of the system in real-time by moving the nodes around and rearranging them, creating an ever-changing sound texture with unique qualities, revealed through the use of a large number of sound sources physically distributed in space.

My intent with this project is twofold. On one hand, I wish to explore how we can leverage emergent phenomenons to design more engaging audio/visual experiences. On the other, I hope that the direct manipulation of the nodes will help viewers get a better understanding and appreciation of emerging patterns within distributed systems.

.

Flexible Urban Displays

This project explores how programmable surfaces can be shaped and textured in more flexible ways than traditional LED displays. By using modular tiles as building blocks, displays can become an integral part of objects, structures and spaces.