First there was Flippaper, a project that allows you to create your own pinball design with colored markers on paper, and transform it on actual interaction directly on paper. Draw, and play directly on Paper!
Over time, we realised that this idea of interaction between colour and paper was more than just one project worthy and that we were not bound by paper and markers. This motivated us to first create a library and then release setups to ease the whole canvas/pigment interaction process.
Our core principle is to be able to interact with a drawing made on any surface. More than that, it's to allow the machine to behave in a way that is linked with the drawing. Sometimes this will end up as interactions (for instance Flippaper) sometimes it can stay generative (a machine that will try to complete the drawing you gave it).
For that to happen, our technology will issue a set of descriptions from the drawing captured. This description will be then linked with behaviour that will define how the machine (and user) interact with the drawing.
The canvas can be a wall, a chalkboard, a pancake, skin... and the drawing can be based on paint cans, magnets, pens, coloured sauces...
In order to both capture the drawing and draw on top of it, you need a webcam, a video projector and a good set up. For that, we're creating a stand that makes it easy to use the whole system both on a table and on a wall. Papertronics Kit is very convenient for prototyping, as good for exhibiting your projects. Perfect for workshops and education.
The library : PTX system
Right now, the library exist both in C++ (we use it with Cinder, should work with everything) and in Java (aimed at Processing). Once all calibration is done, the library returns you a list of areas (each is a separate part of your drawing) with a list of descriptions. It's then up to you to use them in your code to give life to any idea!
Curious about all that? Drop us a message by e-mail or through the social links in the top navigation bar, we'll be happy to hear from you!