Face Cap Live Mode into Unity

Facial motion Capture in real-time for video blogs and channel hosts! Record videos with Unity and your custom avatar!

I’ll take you through my entire process, how I set up my studio, Unity plug-ins, WiFi tricks, OSC and sample scenes from GitHub, and more!

Skinn: Vertex Mapper – add clothing in Unity and export to FBX

Video tutorial for a (free) Unity tool that can skin conforming clothes to your Fuse figures.

(suitible for beginners and casual-users of Unity).

Fixes the limitations of the Fuse/Auto-rigger workflow. You can add unlimited skinned meshes after the figure has been auto-rigged. You can also skin meshes that Fuse doesn’t like – clothes with multiple materials or voluminous shapes.

The tool will copy the bones and weight-painting from your Fuse figure into clothing you’ve made in Marvelous Designer (or other software). The clothing is added as a sub-mesh on your Fuse figure, just like the Auto-rigger does.

I also show how to export as new stand-alone figure – with the bones, blend shapes, and conforming clothes intact – to FBX 2020!

Future-proof, and customize your Fuse characters. Add multiple costume/hair options, or create a base character and add the clothes later. 

iPhone X vs Mixamo: Blend Shapes

Apple’s ARKit FACS blend shapes compared to Mixamo’s FACS blend shapes.

red indicates there is no equivalent blend shape on the other system

iPhone X

forehead
0 :  browInnerUp 
1 :  browDown_L 
2 :  browDown_R 
3 :  browOuterUp_L 
4 :  browOuterUp_R 

look
5 :  eyeLookUp_L 
6 :  eyeLookUp_R 
7 :  eyeLookDown_L 
8 :  eyeLookDown_R 
9 :  eyeLookIn_L 
10 :  eyeLookIn_R 
11 :  eyeLookOut_L 
12 :  eyeLookOut_R 
Mixamo uses eye bones

eyes
13 :  eyeBlink_L 
14 :  eyeBlink_R 
15 :  eyeSquint_L 
16 :  eyeSquint_R 
17 :  eyeWide_L 
18 :  eyeWide_R 

cheek
19 :  cheekPuff 
20 :  cheekSquint_L 
21 :  cheekSquint_R 

nose
22 :  noseSneer_L 
23 :  noseSneer_R 

jaw
24 :  jawOpen 
mouthOpen on Mixamo
25 :  jawForward 
26 :  jawLeft
27 :  jawRight 

lips
28 :  mouthFunnel 
mouthNarrow on Mixamo
29 :  mouthPucker 
mouthWhistle on Mixamo

30 :  mouthLeft 
31 :  mouthRight 
32 :  mouthRollUpper 
33 :  mouthRollLower 
34 :  mouthShrugUpper 
35 :  mouthShrugLower 

36 :  mouthClose 
combines with jawOpen for ‘chew’

smile/frown
37 :  mouthSmile_L 
38 :  mouthSmile_R 
39 :  mouthFrown_L 
40 :  mouthFrown_R 
41 :  mouthDimple_L
42 :  mouthDimple_R 

lips
43 :  mouthUpperUp_L 
44 :  mouthUpperUp_R 
45 :  mouthLowerDown_L 
46 :  mouthLowerDown_R 

jaw
47 :  mouthPress_L 
48 :  mouthPress_R 
49 :  mouthStretch_L
50 :  mouthStretch_R 
jaw rotate on Mixamo

51 :  tongueOut 

Mixamo

eyes
0 :  Blink_Left 
1 :  Blink_Right 

forehead
2 :  BrowsDown_Left 
3 :  BrowsDown_Right 
4 :  BrowsIn_Left 
5 :  BrowsIn_Right 
6 :  BrowsOuterLower_Left 
7 :  BrowsOuterLower_Right 
8 :  BrowsUp_Left 
9 :  BrowsUp_Right 

cheek
10 :  CheekPuff_Left 
11 :  CheekPuff_Right 

eyes
12 :  EyesWide_Left 
13 :  EyesWide_Right 

smile/frown
14 :  Frown_Left 
15 :  Frown_Right 

jaw
16 :  JawBackward 
17 :  JawForeward 

18 :  JawRotateY_Left
19 :  JawRotateY_Right 
20 :  JawRotateZ_Left
21 :  JawRotateZ_Right 
mouthPress, mouthStretch on iPhone

22 :  Jaw_Down 
23 :  Jaw_Left 
24 :  Jaw_Right 
25 :  Jaw_Up 

lips
26 :  LowerLipDown_Left 
27 :  LowerLipDown_Right 
28 :  LowerLipIn 
29 :  LowerLipOut 

30 :  Midmouth_Left 
31 :  Midmouth_Right 
32 :  MouthDown 

33 :  MouthNarrow_Left 
34 :  MouthNarrow_Right 
mouthFunnel on iPhone

35 :  MouthOpen 
jawOpen on iPhone

36 :  MouthUp 

37 :  MouthWhistle_NarrowAdjust_Left 
38 :  MouthWhistle_NarrowAdjust_Right 
mouthPucker on iPhone

nose
39 :  NoseScrunch_Left 
40 :  NoseScrunch_Right 

smile/frown
41 :  Smile_Left 
42 :  Smile_Right 

eyes
43 :  Squint_Left 
44 :  Squint_Right 

45 :  TongueUp 

lips
46 :  UpperLipIn 
47 :  UpperLipOut 
48 :  UpperLipUp_Left 
49 :  UpperLipUp_Right 

iPhone X vs Mixamo: Blend Shapes Smackdown

I compare the iPhone X blend shapes with Mixamo blend shapes! My suggestions for remapping with Face Cap to a stock Adobe Fuse figure with Auto-rigger blend shapes. Plus, some history on how these 2 systems evolved and types of blend shapes typically found on 3D figures.

I made a child for Adobe Fuse

I demo the child body base I made for Adobe Fuse….

My puppet head is a bit wobbly because I’m running too many real-time apps on my computer.