《Solved》 LipSync Sound Tool Error!?

MinGeunPark

I try export volume data from Live2D Sound Export Tool for LipSync.
But, i dropped my file(*.wav) to this tool and i see this error.




Of course I did install Java(32bit) and QuickTime.
How can i fix it?

Tod

Hi MinGeunPark,

The error says that the file path contains Japanese characters (or some characters that the system cannot handle).

I advise you to check to see if the file path (folder names) contains any non-alphabetical characters. And if there is, rename with alphabetical letters.

MinGeunPark

Hi Tod.
Thanks for your answer.

but It's Not Solve Problem.

You Look Screenshot. Path is "Z:\1040021.wav" not contain Japanese Characters.
I Try "Z:\" Folder on korean windows.

Can i get other solve this problem?

Tod

OK, you might be able to get around the error by trying this:

Step1. In Animator, export an .mtn file.
Step2. In Unity, call the audio file for lip-sync (Refer to the sample project “LipSync” bundled in Cubism SDK for Unity)

(Step1 - Exporting an .mtn file)
In Animator, open any model and load audio files and go to [Scene(S) > Generate a scene automatically from the audio file]. Then export an .mtn file from [File > Output Motion Data]. Finally, use this .mtn file and the original audio file in sync on Unity.
http://sites.cybernoids.jp/cubism2/animator/basic/sound-utility

MinGeunPark

Hi Tod.
Sadly, I don't use Unity. I use owner engine.

Actually, I want try test for wav sound & lip-sync animation on Runtime not pregenerated mtn.

So, i wanna test wav file export to lip-sync parameter value with my Live2d Model.
But your sound volume export tool is don't work for me.

Tod

It doesn't have to be Unity. The idea is to generate lip-sync parameter values in a form of .mtn file based on audio input and then synchronize the animation file with the original audio input in your Engine.

MinGeunPark

Thanks Tod.
Yes. I understand your answer. Thank you.

But. I need text file that wrote lip-sync parameters from audio not mtn file.
Like your sound tool export file.

So, can i use your sound tool?
Or can i export lip-sync parameter from mtn file? (generated Lip-sync mtn from audio)

Tod

The method I wrote generates lip-sync animation from audio file, not from a different .mtn file.

https://translate.googleusercontent.com/translate_c?act=url&depth=1&hl=ja&ie=UTF8&prev=_t&rurl=translate.google.com&sl=ja&tl=en&u=http://sites.cybernoids.jp/cubism2/animator/basic/sound-utility&usg=ALkJrhjf6K2jE8Qvkbhr2xMlAahPtgXkmQ

You can also refer to the following document.

https://translate.googleusercontent.com/translate_c?act=url&depth=1&hl=ja&ie=UTF8&prev=_t&rurl=translate.google.com&sl=ja&tl=en&u=http://sites.cybernoids.jp/cubism2/sdk_tutorial/live2d_library/load_to_play_motion/talk&usg=ALkJrhgQxarsIQy5C9TD0uxxYgAJGbLM4w

Or, if you can try this again to see if you can get the extraction tool working:
https://translate.googleusercontent.com/translate_c?act=url&depth=1&hl=ja&ie=UTF8&prev=_t&rurl=translate.google.com&sl=ja&tl=en&u=http://sites.cybernoids.jp/cubism2/tools/lipsync&usg=ALkJrhiUcSP8vgeYyXvpWLpGlT3WXydcdg

MinGeunPark

Hi Tod. Thank you.

Yes. i want extract file. Not mtn that generated from audio.

First, i try your extraction tool. but It is don't working.
My question is this problem.
(See my first question. T^T)

I want you help me for extraction tool working.

MinGeunPark

Ok! I guess found solve this problem.

I didn't know mtn file is text file!! That was wrote anim parameters.

I will try this solve method tomorrow.
1. make mtn for lip-sync from audio file
2. And extract value of lip animation parameter per frame. (mtn is text file!)
3. And apply that value to runtime code for lip-sync animation.

Thank you very much Tod!

Tod

Great! Let me know if this works out!

MinGeunPark

Hi Tod..

Hmm...I take another problem.

I thought above solution.

I try this.
1. wav file import animtion tool.
2. Select Generate scene from audio file.

And I guess audio volume data extract to timeline track.
(like this https://translate.google.com/translate?act=url&depth=1&hl=ja&ie=UTF8&prev=_t&rurl=translate.google.com&sl=ja&tl=en&u=http://sites.cybernoids.jp/cubism2/animator/basic/sound-utility)

But. My lip-sync track didn't show my animation timeline.



Test Wav file is this.

What can i do to solve this problem.

FxaYuan

hello MinGeunPark

Okay this is the solution:
1. For this version you must use animator 32bit otherwise it won't work
[we are working on 64bit version in the future to enable this feature]

2. Reinstall/Modify QuickTime using this setting (Quictime for Java is turn on):


After you have install the QuickTime and using 32 bit version:
1. Drag the model and audio into one scene file
2. then select the model inside the scene file
3. Select Generate scene from audio file.
4. Done!

MinGeunPark

I solved above Problem.
Lip-sync trace was not created because It's Quicktime for Jave Problem!
I solve by this page.
http://sites.cybernoids.jp/cubism_e/faq/editor/quicktime7

But.. Sadly i take another problem again.



audio value output is fail... T^T

MinGeunPark

Hi Yuan.

I wrote solve that problem at same time with you.
and.. I take another problem..
(above comment)

FxaYuan

hello MinGeunPark

ah... glad it solved about the Java plugin,
and did you use the same audio file above?

MinGeunPark

Hi Yuan.
Yes. i try test above audio file.

I try 32bit Cubism But I see this message.


I already install Quicktime for java and copy QTJava.zip to Live2D Cubism Folder.

and run generate scene from audio then i see above fail message.

FxaYuan

hi MinGeunPark, how about if you just installed the QuickTime with the picture I gave to you, (without copy the QTjava.zip) is that work? and what version did you use anyway?

MinGeunPark

Hm.. Actually I don't know 32 bit Cubism work before. because i always test 64 bit cubism.

my QuickTime ver is 7.77.80 and Cubism's ver is 2.0(2014/09/02)

MinGeunPark

Yes. I guess solve this problem probably.

First, cubism was still failed open QuickTime on my PC. But it was work fine other my artist PC.

Second, I find "generate scene from audio..." is just generated scene! Not volume data from audio! "Effect - lip sync" menu is generate volume data!!

So, now I have volume data that I need.
But, this work is don't enable on my PC still.

Anyway, I take that I need.

Thank you tod, and yuan!

FxaYuan

Yes its from scene data bind together with the model itself.

ah great to hear you have find the way out MinGeunPark...