Skip to content

Commit

Permalink
Revert "Merge pull request #11 from HakuyaLabs/MISSINGNO"
Browse files Browse the repository at this point in the history
This reverts commit 47eccc6, reversing
changes made to 8bdb315.
  • Loading branch information
Nekotora committed Jun 17, 2024
1 parent febc2c3 commit 44199f9
Show file tree
Hide file tree
Showing 9 changed files with 144 additions and 147 deletions.
16 changes: 8 additions & 8 deletions docs/mocap/face-tracking.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,21 +2,21 @@
sidebar_position: 20
---

# 面部追踪
# Customizing Face Tracking

## 蓝图自定义
## Blueprint Customization

在开播准备环节,您可以点击 **面部追踪进阶设置…** 来对蓝图进行定制。
During the onboarding process, you can click **Customize Face Tracking...** to customize the tracking blueprint.

![](/doc-img/en-mocap-3.png)
<p class="img-desc">Customizing face tracking.</p>

目前我们提供以下几种选择:
The following options are available:

* **BlendShape 映射:** 选择适合您模型的 BlendShape 映射。比如说,如果您的模型带有 "Perfect Sync"/ARKit Blendshape, 请您选择 **Arkit**; 如果您的模型是由MMD模型转换而来,请选择 **MMD** ;其他请选择 **VRM**Warudo 会尝试自动识别模型类型,但您也可以在这里手动更改类型。-
* **启用头部和身体运动:** 此选项开启时,Warudo 会尝试基于动捕数据来同时运动模型的头身部分。在您使用完整的全身动捕系统的情况下,此选项会被开播助手设置为**关闭**
* **头部待机动画 (自动眨眼/自动眼部动作/自动摇头):** 在开启状态下,Warudo 会给角色增加微小的头部、眼部动作。
* **视线:** 此选项开启时,,您的角色视线会望向指定方向(默认指向摄像机位)。这样可以帮助您在任何机位下保持与观众的眼神交流并允许您的头部自由转动。
* **BlendShape Mapping:** Select the blendshape mapping that matches your model. For example, if your model has "Perfect Sync"/ARKit blendshapes, select **ARKit**; if your model is converted from a MMD model, select **MikuMikuDance**; otherwise, select **VRM**. By default, Warudo will try to automatically detect the blendshape mapping, but you can override it here.
* **Enable Head and Body Movements:** If enabled, Warudo will move your character's head and body according to the tracking data. If disabled, only the face (blendshapes and eye bones) will be animated. This is automatically set to **No** by the onboarding assistant if you use a full-body pose tracking system that already tracks the head and body.
* **Idle Head Animation (Auto Blinking / Auto Eye Movements / Auto Head Movements):** If enabled, Warudo will add subtle head motion, eye movement, and blinking to your character.
* **Look At:** If enabled, your character will look at a target (default to the camera) when you look forward. This helps your character / you maintain eye contact with the audience regardless of the camera position, while still allowing your character / you to look around freely.
* **Lip Sync**: If enabled, Warudo will animate your character's mouth based on your speech. You can choose to enable lip sync only when tracking is lost, or always enable it.

:::info
Expand Down
44 changes: 22 additions & 22 deletions docs/mocap/leap-motion.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,49 +2,49 @@
sidebar_position: 70
---

# Leap Motion 控制器
# Leap Motion Controller

使用 [Leap Motion 控制器](https://leap2.ultraleap.com/leap-motion-controller-2/)进行手部捕捉。
Hand tracking via [Leap Motion Controller](https://leap2.ultraleap.com/leap-motion-controller-2/).

## 初始设置
## Setup

为了更准确和稳定的手部捕捉,我们推荐您使用更新一代的Leap Motion 控制器 2,但Warudo也支持使用初代Leap Motion 控制器进行捕捉。
We recommend using a Leap Motion Controller 2 for more accurate and stable tracking. The original Leap Motion Controller is also supported.

您将需要下载安装最新的[Gemeni软件](https://leap2.ultraleap.com/gemini-downloads/)以将您的Leap Motion 控制器连接到Warudo。
To connect the Leap Motion Controller to Warudo, you need to download and install the latest Gemini software from [Leap Motion's website](https://leap2.ultraleap.com/gemini-downloads/).

Warudo支持 Leap Motion 控制器提供的所有三种捕捉模式:**Desktop(将设备置于桌面上时)**, **Screen Top(将设备置于屏幕顶部时)**, 以及 **Chest Mounted(颈挂式)**。为了更好的体验,我们推荐在使用颈挂式捕捉模式时,使用一个[颈挂](https://www.etsy.com/market/leap_motion_mounting)
Warudo supports all 3 tracking modes offered by the Leap Motion Controller: **Desktop**, **Screen Top**, and **Chest Mounted**. We recommend using the **Chest Mounted** mode along with a [neck/chest mount](https://www.etsy.com/market/leap_motion_mounting) for the best experience.

## 校正 {#Calibration}
## Calibration {#Calibration}

总体来讲,Leap Motion 控制器并不需要校正即可使用。但您可以在 **Leap Motion 控制器 Asset** 中调制**控制器位置偏移****控制器旋转偏移**,以及**控制器缩放比率** 来调整捕捉效果。该界面中将会显示一个虚拟的 Leap Motion 控制器图标,以帮助您可视化的校正动捕效果。
There is generally no need to calibrate the Leap Motion Controller. However, you can adjust **Controller Position Offset**, **Controller Rotation Offset**, and **Controller Scale** in the **Leap Motion Controller** asset to adjust the tracking. A virtual Leap Motion Controller will be displayed in the scene to help you visualize the tracking.

![](/doc-img/en-leapmotion-1.png)
<p class="img-desc">图为调整 Leap Motion 控制器的示意图。</p>
<p class="img-desc">Adjusting the virtual Leap Motion Controller.</p>

## 选项
## Options

* **控制器位置偏移**: 对传感器的三维空间坐标位置进行调整,正数X值会将传感器位置向左侧调整,反之则向右侧调整。正数Y值会将传感器位置向上方调整,反之则向下方调整。正数Z值会将传感器位置向前方调整,反之则向后方调整。
* **控制器旋转偏移**: 平面旋转虚拟 Leap Motion 控制器,以调整传感器的角度。
* **控制器缩放比率**: 此参数为调整传感器的距离感应比例,调整它可以改变模型手部和身体的距离感应灵敏度。你也可以使用 **对每个轴单独缩放** 来单独精调传感器在每个方向上的灵敏度。
* **修正手指朝向权重**: 由于每个人物模型的参数不同,Leap Motion 控制器中手指的朝向可能与模型中手指的朝向不同步,这个参数可以让您调整手指的朝向,以使模型显示的动作与传感器捕捉到的动作同步。0代表不做任何调整,1代表最高修正值。请您持续调整,直至模型看上去效果自然。
* **修正肩部朝向权重**: 这个参数会改变模型肩部的旋转角度,0代表不做任何调整,1代表完全翻转,请您持续调整,直至模型看上去效果自然。
* **Controller Position Offset**: The offset of the controller position. Positive X is a left offset, positive Y is an upward offset, and positive Z is a forward offset.
* **Controller Rotation Offset**: The offset of the controller rotation.
* **Controller Scale**: The scale of the controller. Increase this value if you want hands to be further away from the body. You can also enable **Per-Axis Scale** to scale the controller on each axis separately.
* **Fix Finger Orientations Weight**: Due to different model specifications, the finger orientations of the Leap Motion Controller may not match the finger orientations of the model. This option allows you to adjust the finger orientations of the Leap Motion Controller to match the model. 0 means no adjustment, 1 means full adjustment. Adjust this value until the fingers look natural.
* **Shoulder Rotation Weight**: How much the shoulders should be rotated. 0 means no rotation, 1 means full rotation. Adjust this value until the shoulders look natural.

## 常见问题{#FAQ}
## Frequently Asked Questions {#FAQ}

常见问题请参考[动作捕捉方案一览](overview#FAQ)以及[姿态追踪](body-tracking#FAQ)
Please refer to [Overview](overview#FAQ) and [Customizing Pose Tracking](body-tracking#FAQ) for common questions.

### **Leap Motion 追踪器显示**"Tracker not started."
### The Leap Motion Tracker asset says "Tracker not started."

请确保您已下载并安装最新版本的[Gemini软件](https://leap2.ultraleap.com/gemini-downloads/),并且程序已在后台运行。
Please make sure you have installed the latest [Gemini software](https://leap2.ultraleap.com/gemini-downloads/), and it is running in the background.

### 我的模型的手腕/手指看着很奇怪。.
### My model's wrist/fingers look unnatural.

请尝试在**Leap Motion 追踪器 Asset**中调整**修正手指朝向权重(手指方向修正权重)** 选项,您可能也需要调整**手腕旋转偏移** **全局手指旋转偏移** 选项。(您可以在选项左侧的方框内开启它们)
Try adjusting the **Fix Finger Orientations Weight** option in the **Leap Motion Tracker** asset. You may also need to adjust the **Wrist Rotation Offset** and **Global Finger Rotation Offset** options (check the left boxes to enable them).

<AuthorBar authors={{
creators: [
{name: 'HakuyaTira', github: 'TigerHix'},
],
translators: [
],
}} />
}} />
32 changes: 16 additions & 16 deletions docs/mocap/mocopi.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,43 +2,43 @@
sidebar_position: 80
---

# 索尼 Mocopi
# Sony Mocopi

[索尼 Mocopi](https://electronics.sony.com/more/mocopi/all-mocopi/p/qmss1-uscx)进行动作捕捉。
Body tracking via [Sony Mocopi](https://electronics.sony.com/more/mocopi/all-mocopi/p/qmss1-uscx).

## 初始设置
## Setup

请先参照[索尼官方教程](https://www.sony.com/electronics/support/articles/00298063)来对Mocopi进行初始设置。
Follow the [official tutorial video](https://www.sony.com/electronics/support/articles/00298063) to set up Sony Mocopi.

在初始设置完成之后,在Mocopi手机应用程序的设置页面中,选中**External device connection settings(外部设备连接设置)**,将**Transfer Format** 设置为**mocopi(UDP)**,然后再**IP address**中输入您的计算机IP地址。
Then, enter the settings page on the Mocopi app. In **External device connection settings**, select **mocopi (UDP)** for **Transfer format**, and enter your computer's IP address for **IP address**.

:::tip
如果您不知道电脑的IP地址,可以在**Mocopi 接收器**素材的设置页面中找到。
If you do not know your computer's IP, you can check on the configuration page of the **Mocopi Receiver** asset.

![](/doc-img/en-ifacialmocap-1.png)

如果出现了多个IP,您将需要一个一个尝试。通常来说,您的路由器分配的IP会以`192.168`打头,比如在例图中的情况下,您可以先尝试`192.168.1.151`
If multiple IPs are listed, you would need to try each one. Usually, the IP address assigned to your computer by your WiFi router starts with `192.168`. For example, in the above picture, you can first try `192.168.1.151`.
:::

回到主界面,点击顶部菜单栏中的 **Motion**然后点击**SAVE**图标以进入 **SEND** 模式。点击底部绿色的发送按钮来开始传送数据。
Go back to the main interface, tap **Motion** on the menu bar, and tap the **SAVE** icon to switch to the **SEND** mode. Tap the green send button at the bottom to start sending tracking data.

![](/doc-img/en-mocopi-1.png)

## 校正
## Calibration

Sony Mocopi的校正需要在Mocopi应用程序中完成。
Calibration of Sony Mocopi is done in the Mocopi app.

## 选项
## Options

* **动作缓冲**: 选择是否开启Mocopi自带的动作缓冲功能(该功能可以让动作较为平滑)。由于Warudo自身会对捕捉数据进行平滑处理,这个设置通常不需要开启。
* **Motion Buffering**: Whether to enable Mocopi's built-in motion buffering. This can usually be disabled because Warudo already smooths the motion data.

## 常见问题
## Frequently Asked Questions

常见问题请参考[动作捕捉方案一览](overview#FAQ)[姿态追踪](body-tracking#FAQ)页面。
Please refer to [Overview](overview#FAQ) and [Customizing Pose Tracking](body-tracking#FAQ) for common questions.

### 我的动捕结果经常会自己平移
### My tracking drifts over time.

这种随着时间一点点增大,导致动捕结果平移的误差是惯性动捕系统的常见问题。请尽量减少动捕设备周边的电磁干扰来减少漂移问题。
This is a common issue with inertial motion capture systems, which drift over time due to accumulated errors. To reduce the drift, make sure there are no magnetic or electrical interference near the tracking sensors.

<AuthorBar authors={{
creators: [
Expand Down
22 changes: 10 additions & 12 deletions docs/mocap/noitom.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,28 +2,27 @@
sidebar_position: 120
---

# 诺亦腾 Axis
# Noitom Axis

使用[诺亦腾 Axis Studio软件](https://neuronmocap.com/pages/axis-studio)或者[Axis Neuron软件](https://neuronmocap.com/pages/axis-neuron)进行动作捕捉。 这个动捕方法需要使用官方售卖的[诺亦腾 Perception Neuron](https://neuronmocap.com/)动捕服装。
Body tracking via [Noitom Axis Studio](https://neuronmocap.com/pages/axis-studio) or Axis Neuron. Requires a [Noitom Perception Neuron](https://neuronmocap.com/) suit.

## 初始设置
## Setup

打开[诺亦腾 Axis Studio软件](https://neuronmocap.com/pages/axis-studio)并在如图的**Settings → BVH Broadcasting** 中打开BVH串流
Open Noitom Axis Studio and enable BVH streaming in **Settings → BVH Broadcasting** (toggle the switch at the top right).

![](/doc-img/en-noitom-1.png)

## 校正
## Calibration

Noitom动捕服装的校正需要在[诺亦腾 Axis Studio软件](https://neuronmocap.com/pages/axis-studio)或者[Axis Neuron软件](https://neuronmocap.com/pages/axis-neuron)中进行。
Calibration of Noitom hardware is done in Noitom Axis Studio or Axis Neuron.

## 常见问题
## Frequently Asked Questions

常见问题请参考[动作捕捉方案一览](overview#FAQ)[姿态追踪](body-tracking#FAQ)页面。
Please refer to [Overview](overview#FAQ) and [Customizing Pose Tracking](body-tracking#FAQ) for common questions.

### 我的动捕结果经常会自己平移
### My tracking drifts over time.


这种随着时间一点点增大,导致动捕结果平移的误差是惯性动捕系统的常见问题。请尽量减少动捕设备周边的电磁干扰来减少漂移问题。
This is a common issue with inertial motion capture systems, which drift over time due to accumulated errors. To reduce the drift, make sure there are no magnetic or electrical interference near the tracking sensors.

<AuthorBar authors={{
creators: [
Expand All @@ -32,4 +31,3 @@ Noitom动捕服装的校正需要在[诺亦腾 Axis Studio软件](https://neuron
translators: [
],
}} />

Loading

0 comments on commit 44199f9

Please sign in to comment.