MotionBuilder Hand Dubbing: Recording over pre-recorded data using the StretchSense Gloves

Requirements

• StretchSense Hand Engine: Login to your account page on http://www.stretchsense.com/my-account  or email support@stretchsense.com for details.
• Autodesk MotionBuilder 2016 or later
• MotionBuilder Hand Engine Plugin. 

• Download the most up-to-date Plugins from the Downloads Section of your StretchSense Account at stretchsense.com/my-account/

• Operating System: Windows 10

Setting up your MotionBuilder Project

1. Download and Install the StretchSense Hand Engine and MotionBuilder

NOTE: for this example, we are using version MotionBuilder 2020 

2. Load in your body asset into MotionBuilder with recorded body and/or hand data

3. Launch Hand Engine and set up your hands.

4. Setup Remapping to target character FBX in MotionBuilder (FBX scanned into HE remap tool must be set up for remapping in T-Pose at the first frame and L or Paddle Pose for hands. See image below, for example, FBX to scan into HE)

Refer to the remapping guides below:  

• Remapping to a Custom Character in HE

5. Setup streaming to MotionBuilder. You can use one glove to drive either the left or right hand.

6. Tick the recording checkbox on the MotionBuilder Plugin to be able to record the live-streamed hand data on your target character in MotionBuilder

7. Hit the Record Button and Create a new take. When prompted select yes to copy the data from the current take to the new take so you can always go back to the original take.

8. You can now puppeteer or animate your character’s hands alongside body animation by pressing the record button on your newly created take. We recommend playing at half the speed (or slowed down speed e.g. 1/10th of normal speed) when recording in MotionBuilder directly onto your target character.

 


For example, in the images below the single index finger touching the wrist in the original recording has now been re-recorded to have the index and middle finger touch the back of the wrist (note the same time stamp between recordings).