face time?

I found some interesting software by Kyle McDonald called FaceOSC (https://github.com/kylemcdonald) which tracks head position and facial expression and outputs OSC messages. Here’s a YouTube clip of a simple attempt at using it to control a single reed model in mmi:

Posted in Uncategorized | Leave a comment

it’s all about mmi…

I’ve posted a demo on YouTube using Reactivision to control a plucked string. With a PS3 Eye it’s giving 40 FPS which is quite responsive, but it should be possible to get higher frame rates than that.

The wiimote video from my last post is also now on up on my YouTube channel.

My channel: http://www.youtube.com/rpolfreman

Posted in Uncategorized | Leave a comment

more mmi

I’ve put a new video on YouTube showing use of Kinect to pluck a string with a number of parameters being controlled by hand positions.

Non-linear mapping has been added to mmi using linear interpolation and table objects in Max.

The mmi wii controller patch has been updated to include Motion Plus (i.e. gyros) when available. This gives speed and orientation of the wiimote, but subject to drift. A basic correction of roll and pitch using accelerometer data has been included, but needs refinement. I’ll post a video demo soon.

Posted in Uncategorized | 1 Comment


added a new page about some software I’m developing called MMI (Multi Modal Instrument), with some screenshots and a short YouTube example using a Kinect to control physical modelling synthesis.

Posted in Uncategorized | Leave a comment

blog: the first

started construction of this site

Posted in Uncategorized | Leave a comment