diff --git a/README.md b/README.md index dd9d61d8..896ebf1a 100644 --- a/README.md +++ b/README.md @@ -12,8 +12,18 @@ - We extend the streamlit demo `scripts/demo/video_sampling.py` and the standalone python script `scripts/sampling/simple_video_sample.py` for inference of both models. - Please check our [project page](https://sv3d.github.io), [tech report](https://sv3d.github.io/static/paper.pdf) and [video summary](https://youtu.be/Zqw4-1LcfWg) for more details. +<<<<<<< HEAD +To run SV3D_u on a single image: +- Download `sv3d_u.safetensors` from https://huggingface.co/stabilityai/sv3d to `checkpoints/sv3d_u.safetensors` +- Run `python scripts/sampling/simple_video_sample.py --input_path --version sv3d_u` + +Additionally for SV3D_p, +- Specify sequences of 21 elevations and 21 azimuths (in degrees) to `elevations_deg` ([-90, 90]), and `azimuths_deg` [0, 360] in sorted order from 0 to 360. For example: +`python scripts/sampling/simple_video_sample.py --input_path --version sv3d_p --elevations_deg [] --azimuths_deg []` +======= To run SV3D on a single image: `python scripts/sampling/simple_video_sample.py --input_path --version sv3d_p` +>>>>>>> main To run SVD or SV3D on a streamlit server: `streamlit run scripts/demo/video_sampling.py` diff --git a/scripts/sampling/configs/sv3d_p.yaml b/scripts/sampling/configs/sv3d_p.yaml index bb3747c7..af6e1ea9 100644 --- a/scripts/sampling/configs/sv3d_p.yaml +++ b/scripts/sampling/configs/sv3d_p.yaml @@ -3,7 +3,7 @@ model: params: scale_factor: 0.18215 disable_first_stage_autocast: True - ckpt_path: checkpoints/sv3d_p_image_decoder.safetensors + ckpt_path: checkpoints/sv3d_p.safetensors denoiser_config: target: sgm.modules.diffusionmodules.denoiser.Denoiser diff --git a/scripts/sampling/configs/sv3d_u.yaml b/scripts/sampling/configs/sv3d_u.yaml index 8a7ce212..2d6f1357 100644 --- a/scripts/sampling/configs/sv3d_u.yaml +++ b/scripts/sampling/configs/sv3d_u.yaml @@ -3,7 +3,7 @@ model: params: scale_factor: 0.18215 disable_first_stage_autocast: True - ckpt_path: checkpoints/sv3d_u_image_decoder.safetensors + ckpt_path: checkpoints/sv3d_u.safetensors denoiser_config: target: sgm.modules.diffusionmodules.denoiser.Denoiser