Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Dear Users,

Now, we are seeking users who can give us a hand with expertise to evolve our software more dynamically.
If you are willing to help us, we’d like you to make a registration for “Live2D Creators Circle” via the link below.
Designers, programmers, translators are especially welcomed so far.
(More detailed explanation will be given to you before we ask you to do tasks)

https://docs.google.com/forms/d/1G5KK_GL3ozwPXtTHrpi_ktbsI8UZf8jlYRSlDworyBo/viewform?usp=send_form

Motion capture for Animation in Live2d

Hello!
My name is james,

i just want to know is there any way to animate a video using motion capture with live2d.

Thank you so much!
Tagged:

Comments

  • I don't think you can animate a live2d model with mo-cap data. The movement range of a live2d model is pretty limited (by the original illustration), so you can't do the dynamic action that you can with traditional 3D model. If it's just facial expressions, you should be able to do it based on how you make your live2d model and link up parameters.
  • Yes, " If it's just facial expressions, you should be able to do it based on how you make your live2d model and link up parameters". ... yes, thats what i am asking. can u please tell me how to do that?
    (its for animating a video, not live rendering for games)

    Well, if its not motion capture, Drag function looks promising, but how to add custom drag funtions..
  • I think you should check this out:


    I think face tracking was done with FaceShift Studio and the parameters were linked with parameters of the Live2D model on Unity.

    And this guy did something similar using Kinect and Unity:

    (Second guy in the session)
  • Wow thanks, i got the idea!
  • is that possible to generate the animator file with the script,
    so that we can load that file in animator and rendering the final video...
  • I don't know. It may be possible if you can somehow transform your facial data into .mtn... but I don't think there is any easy way.

    Why not just use auto lip-sync and do the manual facial expression like this one? It's probably much easier, faster, and better quality.


Sign In or Register to comment.