Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

arkit的数据怎么转训练数据? #79

Open
stanle1 opened this issue May 30, 2023 · 4 comments
Open

arkit的数据怎么转训练数据? #79

stanle1 opened this issue May 30, 2023 · 4 comments

Comments

@stanle1
Copy link

stanle1 commented May 30, 2023

试过用 nvidia audio2face,用wav生成,对应的bs数据集,然后转为对应训练数据,发现效果很差。

话则有提供 arkit采集的方案,生成训练数据?

因为看原训练数据的权重和arkit有出入。demo数据有 正负

@SZNero
Copy link
Collaborator

SZNero commented May 30, 2023

  1. 如果是ARkit的数据集化,自己采集可以用Avatary进行采集生成,也可以用iphone app采集,并同步录制声音。
  2. 我们也在准备Arkit数据集,但是现在还在采集中,暂未开放。

@stanle1
Copy link
Author

stanle1 commented May 30, 2023

ios app ue的live link face 采集数据行吗。主要是目前用nvidia的a2f再训练效果基本不能看。不在弄清数据集的情况下,不想在花人力去做arkit的数据集

@CarryChang
Copy link

nv 的数据主要是拉丁发音为主,中文支持并不好,iphone 通过 livelink 录制的 arkit 基本属于 toy 数据集,精度不够

@SaltedSlark
Copy link

nv不是新增了一个亚洲女性吗?我试了一下中文口型还是很好的,老哥们有试过吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants