I’ve been doing some deeper research into Tangible User Interfaces (TUI), and specifically–multitouch screen technologies.  As a Flash developer, I’ve been waiting for the day to put my interactive art onto a touch-screen surface.  I’m amazed to discover just how far things have come, and especially in the blooming creative community developing around open-source and easy to use components.  People are making their own mini-multitouch screen hardware devices (for $5 - $50), sharing loads of code across cross-platform, artistically supportive open source frameworks, and co-creating some incredible applications.

We are on the verge of a Human-Computer Interaction (HCI) revolution … based on audio, visual, physical and kinesthetic sensations.

Here are a few videos that represent some of the aspects of interface extention:

MultiTouch Screen Physics beauty:

Tangible User Interface Objects (TUIO) and gestures:

 
Muilti-User Music Creation:

User 3D head tracking and gaze interaction:

Sudden motion kinesthetic sensing and reaction:

Various Projects in Audio / Visual Social Augmentation:

Some links:

More Multi-Touch Screen videos

Open Frameworks

Natural User Interface

NUI Group

Building Your First Multi-Touch Screen Application in Flash

JazzMutant