123D Catch - 3D Fun from AutoDesk

123D Catch is an AutoDesk product. It's free for your iOS device and there is a web version for your laptop available at http://www.123dapp.com/catch . There is also a PC version that you can download from the same site.

According to the iTunes description ...  

Use your camera to capture the people, places and things around you as amazingly realistic 3D experiences. Capture friends, sculptures, buildings or anything else you can photograph. Automatically transform them into interactive 3D models that can be shared with friends, family, and an ever growing community of 3D photographers.

• Turn your photos into realistic 3D models by taking a series of photographs from different angles.
• Be guided through the process of capturing all angles of your subject with the Integrated Photo Compass.
• Capture 3D portraits of your friends, museum displays, architecture, plants, cats or anything else you can photograph.
• Share your captures with friends through Twitter, Facebook, Email and SMS.
• Showcase your work and follow other amazing 3D photographers from around the world through the in-app gallery.
• Store your captured objects in the cloud to access them from all your devices.
• Use the 123D Catch web app for healing and 3D printing your captures in a web browser! (123d.autodesk.com/catch)
• Export 3D models in a variety of formats from the 123D online community for use in other 3D tools and projects.
• Works on your iPad/iPhone & iPod Touch.

I can recall using this app on my iPhone about 12 months ago and being underwhelmed. It was not easy to use and you always seemed to end up with models that were just too buggy for much other than showing that you could capture a 3D image. Since late last year the app has had a major refit and it now has a slick interface and is really easy to use. 

In the classroom next to mine the ever creative media studies teacher has been working with year 8 students on stop motion video and they have all these cute little models - including a Sylvanian families house. It looks like this ..

So, I tried to use 123D Catch to get a 3D image of it ... it looks like this at first cut.

So what? I hear you say. Well, unless you have an ulterior motive, then all you've done is use some disk space up, even if it is in the cloud. But, I just do happen to have an ulterior motive. In fact, a couple of them.

Ulterior motive 1: 

123D Catch lets you download your image in a number of formats.

So, I can take the .stl file into our 3D printing software and print out some replacement parts when the doors get broken.

Ulterior motive 2:

Some of my year 10 students are messing around with 3D modelling, animation and gaming using AutoDesk's Maya and Unity's Unity3D. I am too. Its all new to me, and I'm no a graphic artist. My game is about minions (and zombies) and I need a home base for my minions. So, I can take the mesh file of the Sylvanian house that 123D Catch gives me and take it into Maya, where I can make it the required minion colour.

From there I can output as an .fbx file for use in Unity and ...

... I have my minion base just on the outskirts of town! ( and my own minion on the edge of the path ... but that's another story).

Motion Capture and Animation with Year 10 Students

Over recent weeks some of my students have been exploring the realms of motion capture and animation - the sort of stuff that makes some of the special effects in Avatar so cool. If you are not too sure what motion capture (or MoCap) is - then this might try and explain it a little.

And while the clip above talks about the facial capture - we haven't worried about that aspect. We have focussed on the animation of the character. As another example of the type of animation that MoCap "captures", this is another short view

We are fortunate to have a good working relationship with the Auckland University of Technology and the department of Digital Design. John Piper, the Head of Digital Design has been a guiding hand for us in our quest to provide our students with a real life application of advanced animation techniques. AUT have the only MoCap studio outside of WETA Workshops in Wellington, and so our students have been very lucky to get access.

So - what is their project all about?

Everyone knows the wild success of Pixar and Dreamworks animated movies. From Toy Story to Cars to Madagascar to TinTin. What we are attempting is to bring the "very" short story concept to animation. Our students have no experience with animation software, but by exploring concepts in short animated stories they have worked in pairs to create a 30 - 60 second animated story.

As a lofty goal we set our sights on this type of thing ... Pixar's Knick Knack ..

After spending time understanding that there is a story board behind the movie - with everything from character development to conflict to theme - students set about creating their own story lines and characters. During the process they also had to create original art work to be the background prop for their animated story and the audio to accompany the story.

At the moment we are at the stage where the background images, audio has been created. The motion capture has been done and the students are now trying to get to grips with the animation process.

This series of short videos shows the start of the journey from motion capture to animation. We'll follow this one as it develops. 

The Story Line: Stickman

Basically "Stickman" is so thin that when he goes to the closet to get a T-shirt to put on - it falls straight to the floor. He gets the idea to put on weight - and the second part sees him start pushing weights to try and bulk up. That doesn't work, so he gets a bike pump, inserts the tube into his mouth and starts inflating himself with air - to the point he explodes.

Here's the motion capture.

Now - you'll notice the "grey dots" on the suit. These are the "dots" that the cameras (on the stands in the background) are focussed on capturing the motion of. There are dots on the cap, the arms, body, hands, legs and feet. Once this motion file is captured, it then needs to be applied to a 3D model. To do this we have been using MotionBuilder. Here are a couple of versions of the process and what the final MotionBuilder output looks like.

The above file is the motion file with the "dots" - try running the 2 videos above at the same time to see how it works.

The video below is a version of the mapping of the dots captured to a standard 3D model.

The next phase will see the students apply this model and it's motion to their context - and I'll document those stages over the next couple of weeks as they get to grips with either Blender or Maya as they continue on their animation journey.