»research
The goal of the Fluid Interfaces research group is to radically rethink the human-machine interactive experience. By designing interfaces that are more immersive, more intelligent, and more interactive we are changing the human-machine relationship and creating systems that are more responsive to people's needs and actions, and that become true “accessories&rdquoo; for expanding our minds.

current projects

project icon

Hole in the wall

Pranav Mistry



This project is currently starting.
project icon

inktuitive

Pranav Mistry in collaboration with Kayato Sekiya

Despite the advances and advantages of computer-aided design tools, the traditional pencil and paper continue to exist as the most important tools in the early stages of design. The goal of the project ‘inktuitive’ is to combine the intuitive process of creation that is inherent in paper and pencil with the power of computing that the digital design tools provide. Inktuitive also extends the natural work-practice of using physical paper by giving the pen the ability to control the design in physical three-dimensional space, freeing it from its tie to the paper. The intuition of pen and paper are still present, but lines are be captured and translated into shapes in the digital world. The physical paper is augmented with overlaid digital strokes. Furthermore, the platform provides a novel interaction mechanism for drawing and designing using above the surface pen movements. ‘inktuitive’ is an intuitive physical design workspace that aims to bridge the gap and bring together the conventional design tools such as paper and pencil with the power and convenience of the digital tools for design. .



This project is currently demoable.
project icon

Quickies: Intelligent Sticky Notes

Pranav Mistry and Pattie Maes

The goal of 'Quickies' is to bring one of the most useful inventions of the 20th century into the digital age: the ubiquitous sticky notes. 'Quickies' enriches the experience of using sticky notes by linking hand-written sticky-notes to the mobile phones, digital calendars, task-lists, e-mail and instant messaging clients. By augmenting the familiar and ubiquitous physical sticky-note, 'Quickies' leverages existing patterns of behavior, merging paper-based sticky-note usage with the user's informational experience. The project explores how the use of Artificial Intelligence (AI), Natural Language Processing (NLP), RFID, and ink recognition technologies can make it possible to create intelligent sticky notes that can be searched, located, can send reminders and messages, and more broadly, can act as an I/O interface to the digital information world.

For more information, please visit the Quickies project website.

.



Project Homepage | This project is currently demoable.
project icon

SixthSense

Pranav Mistry and Pattie Maes

SixthSense is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. By using a camera and a tiny projector mounted in a pendant like wearable device, SixthSense sees what you see and visually augments any surfaces or objects we are interacting with. It projects information onto surfaces, walls, and physical objects around us, and lets us interact with the projected information through natural hand gestures, arm movements, or our interaction with the object itself. SixthSense attempts to free information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer.

For more information, please visit the SixthSense project website.



Project Homepage | This project is currently demoable.
project icon

TaPuMa

Pranav Mistry in collaboration with Tsuyoshi Kuroki

TaPuMa is a digital, tangible public map that allows people to use their own belongings or the everyday objects they carry with them to access relevant, just-in-time information and to find locations of places or people. TaPuMa envisions that conventional maps can be augmented by using the unique identities and affordances of the everyday objects. The TaPuMa system uses a table-top environment where map and dynamic content is projected on the table. A camera mounted above the table identifies and tracks the locations of the objects on the surface. A software program identifies and registers the location of objects on the table. On the basis of identifications of the objects, the software program provides relevant information visualization to be shown on the table. The projector augments the table and objects on the table with projected digital information from overhead along with the map. The project explores a novel interaction mechanism where physical objects are used as interfaces to digital information. TaPuMa allows users to acquire information through tangible media, the things they carry.



This project is currently demoable.
project icon

thirdEye

Pranav Mistry and Pattie Maes

thirdEye is a new technique that enables multiple viewers to see different things on a same display screen at the same time.

With thirdEye,

• We can have a public sign board where a Japanese tourist sees all the instructions in Japanese and an American in English.

• We don’t need to have the split screen in games now. Each player can see his/her personal view of the game on the TV screen.

• Two people watching TV can watch their favorite channel on a single TV screen.

• A public display can show secret messages or patterns.

• In the same movie theater, people can see different end of a suspense movie.

.



This project is currently demoable.