I'm working on a project mixing live action/realtime video of people with animation generated in realtime, animation to be generated and "tracked" onto the live action video using kinect data.
I'm working with someone who knows what they are doing in terms of making this work form a programming standpoint but obviously our tools are very different and as much as possible I don't want to be just handing off mockups and giving them huge programming challenges (although that is a possible workflow).
I was thinking of using VVVV or processing, but then I got to thinking about Ni MATE http://www.ni-mate.com and Octane, and got to wondering if there was any way to accomplish this using C4D.... (or maybe Blender with the Blender Game Engine)
I have a lot of leeway with the style of animation so I can work within the confines of the technology, I can keep the animation extremely simple if necessary.
Anyhow was curious if anyone had any good ideas of tools to look at, experience doing anything similar, or thoughts on approaches before I dive in and do a bunch of testing and more research.
My goal is to get as much of the way there as I can on my own, using tools as similar to the ones I am used to as possible.