Skip to content

Latest commit

 

History

History
95 lines (67 loc) · 2.97 KB

README.md

File metadata and controls

95 lines (67 loc) · 2.97 KB
Raw

iHuman: Instant Animatable Digital Humans From Monocular Videos [ECCV 2024]

This is official implementation of the paper: "iHuman: Instant Animatable Digital Humans From Monocular Videos".

Learn more on our project page: iHuman

Prerequisites

  • Cuda 11.8
  • Conda
  • A C++14 capable compiler
    • Linux: GCC/G++ 8 or higher

Setup

First make sure all the Prerequisites are installed in your operating system. Then, invoke

conda env create -f environment.yml
conda activate ihuman
cd submodules
bash ./install.sh

Running the code

Step 1: Download Dataset

a. download dataset from this link https://drive.google.com/file/d/1qwM1jdabiJFmEGywuYowKD0-nC2-rWVe/view?usp=share_link
b. place it in {root}/data/people_snapshot/

Step 2: Download Models

a. Download the SMPL v1.1 SMPL_python_v.1.1.0.zip model from the SMPL official website and move and rename SMPL_python_v.1.1.0/smpl/models/*.pkl to PROJECT_ROOT/data/smplx_models/smpl/.

After this the project folder should look like this:

PROJECT_ROOT/data/smpl_model
    ├── SMPL_FEMALE.pkl
    ├── SMPL_MALE.pkl
    ├── SMPL_NEUTRAL.pkl

b. Download the files from this drive link (https://drive.google.com/file/d/17OdyNkfdFKFqBnmFMZtmT9B-6AXKAZeG/view?usp=share_link) and place them in PROJECT_ROOT/data/smpl/small/.

After this the project folder should look like this:

PROJECT_ROOT/data/smpl/small/
    ├── J regressor.txt
    ├── joint locations.txt
    ├── kintree table.txt
    ├── mesh2smpl_idx.txt
    ├── triangles.txt
    ├── uv_coords.txt
    ├── uv_map2face.txt
    ├── vertices.txt
    ├── weights.txt

Step 3:

  1. python train.py

You can modify the training parameters in the conf/mmpeoplesnapshot_fine.yaml file.

Step 4: Animate the rendered model

a. Download the files from this drive link (https://drive.google.com/drive/folders/1XUpygOfdTSx4pKflAzbu7CY7fLTSNAe8?usp=sharing) and place them in PROJECT_ROOT/data/animation.

After this the project folder should look like this:

PROJECT_ROOT/data/animation
    ├── motion
    ├── camera.pkl

b. python animate.py

Acknowledgement

Our code is based on several interesting and helpful projects:

We are grateful to the developers and contributors of these repositories for their hard work and dedication to the open-source community. Without their contributions, our project would not have been possible.