Theatre play with digital puppet

Based on the prototype of a virtual marionette we made a child theatre play with it. The set is a traditional stage with kids as actors. The puppet is on a central screen and is played live on stage by a professional puppeteer.

The main control is a self illuminated ARToolkit marker over a camera to track the position and rotation of the puppet. A game controller was added for better grip and to provide input for more detailed movements like head rotation or stiffness of joints. A hidden control board provided control over the look of the virtual stage, lighting and physical properties like weight and friction of the puppet. (to let it fly)

Small trailer for the theatre play