Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
JunzheJosephZhu authored Jan 2, 2024
1 parent 6e282a9 commit 7aba7a2
Showing 1 changed file with 15 additions and 0 deletions.
15 changes: 15 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -272,6 +272,21 @@ python launch.py --config configs/prolificdreamer-geometry.yaml --train --gpu 0
# texturing with 512x512 rasterization, Stable Difusion VSD guidance
python launch.py --config configs/prolificdreamer-texture.yaml --train --gpu 0 system.prompt_processor.prompt="a pineapple" system.geometry_convert_from=path/to/stage2/trial/dir/ckpts/last.ckpt
```
### HiFA [![arXiv](https://img.shields.io/badge/arXiv-2209.14988-b31b1b.svg?style=flat-square)](https://arxiv.org/abs/2305.18766)
**This is a reimplementation, missing some improvements from the original paper(coarse-to-fine NeRF sampling, kernel smoothing). For original results, please refer to [https://github.com/JunzheJosephZhu/HiFA](https://github.com/JunzheJosephZhu/HiFA)

HiFA is more like a suite of improvements including image space SDS, z-variance loss, and noise strength annealing. It is compatible with most optimization-based methods. Therefore, we provide three variants based on DreamFusion, ProlificDreamer, and Magic123. We provide a unified guidance config as well as an SDS/VSD guidance config for the DreamFusion and ProlificDreamer variants, both configs should achieve the same results.
**Results obtained by threestudio(Dreamfusion-HiFA, 512x512)

**Results obtained by threestudio(ProlificDreamer-HiFA, 512x512)

**Results obtained by threestudio(Magic123-HiFA, 512x512)

**Tips**
If the generated object's color seems oversaturated, decrease lambda_sds_img(or lambda_sd_img if using unified guidance)
If the generated object looks cloudy, increase lamda_z_variance
If the generated object overall seems to have high luminance, increase percentage_min.
Make sure sqrt_anneal and use_img_loss are both set to True.

### DreamFusion [![arXiv](https://img.shields.io/badge/arXiv-2209.14988-b31b1b.svg?style=flat-square)](https://arxiv.org/abs/2209.14988)

Expand Down

0 comments on commit 7aba7a2

Please sign in to comment.