Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge changes #143

Merged
merged 43 commits into from
Feb 9, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
adcbe67
[refactor]Scheduler.set_begin_index (#6728)
yiyixuxu Feb 1, 2024
9cc59ba
[Contributor Experience] Fix test collection on MPS (#6808)
UmerHA Feb 2, 2024
15ed53d
Fixes LoRA SDXL training script with DDP + PEFT (#6816)
younesbelkada Feb 3, 2024
02338c9
Change path to posix (testing_utils.py) (#6803)
Stepheni12 Feb 3, 2024
65329ae
[advanced dreambooth lora sdxl script] new features + bug fixes (#6691)
linoytsaban Feb 3, 2024
13001ee
Bugfix in IPAdapterFaceID (#6835)
fabiorigano Feb 3, 2024
fbdf26b
[dreambooth lora sdxl] add sdxl micro conditioning (#6795)
linoytsaban Feb 4, 2024
a5fc62f
add `self.use_ada_layer_norm_*` params back to `BasicTransformerBlock…
yiyixuxu Feb 4, 2024
f09ca90
Multiple small fixes to Video Pipeline docs (#6805)
DN6 Feb 5, 2024
64909f1
update IP-adapter code in UNetMotionModel (#6828)
yiyixuxu Feb 5, 2024
c6f8c31
Fix forward pass in UNetMotionModel when gradient checkpoint is enabl…
BaaBaaGoat Feb 5, 2024
fdf55b1
Fix posix path issue in testing utils (#6849)
DN6 Feb 5, 2024
bb99623
Update IP Adapter tests to use cosine similarity distance (#6806)
DN6 Feb 5, 2024
8bf046b
Add single file and IP Adapter support to PIA Pipeline (#6851)
DN6 Feb 5, 2024
493228a
Fix `AutoencoderTiny` with `use_slicing` (#6850)
edwardwli Feb 5, 2024
e6fd9ad
[I2vGenXL] clean up things (#6845)
sayakpaul Feb 6, 2024
15f6b22
add attention_head_dim
sayakpaul Feb 6, 2024
4f1df69
Revert "add attention_head_dim"
sayakpaul Feb 6, 2024
e6a48db
Refactor Deepfloyd IF tests. (#6855)
DN6 Feb 6, 2024
994360f
Fix last IP Adapter test (#6875)
DN6 Feb 6, 2024
17612de
fix: typo in callback function name and property (#6834)
felixsanz Feb 6, 2024
76696dc
[Model Card] standardize dreambooth model card (#6729)
sayakpaul Feb 7, 2024
97d004b
[ip-adapter] make sure length of `scale` is same as number of ip-adap…
yiyixuxu Feb 7, 2024
4a3d528
fix: keyword argument mismatch (#6895)
bamps53 Feb 8, 2024
1835510
Remove `torch_dtype` in to() to end deprecation (#6886)
sayakpaul Feb 8, 2024
a11b0f8
Fix: training resume from fp16 for SDXL Consistency Distillation (#6840)
asrimanth Feb 8, 2024
aa82df5
[IP Adapters] introduce `ip_adapter_image_embeds` in the SD pipeline …
sayakpaul Feb 8, 2024
491a933
[I2VGenXL] `attention_head_dim` in the UNet (#6872)
sayakpaul Feb 8, 2024
17808a0
Fix bug when converting checkpoint to diffusers format (#6900)
ehsan Feb 8, 2024
3ac2357
changed positional parameters to named parameters like in docs (#6905)
patrykbart Feb 8, 2024
8de7800
Add fps argument to export_to_gif function. (#6786)
masaishi Feb 8, 2024
30e5e81
change to 2024 in the license (#6902)
sayakpaul Feb 8, 2024
1824d00
fix: load_image should support PIL Image (#6904)
Laisky Feb 8, 2024
f5c9be3
Remove <cat-toy> validation prompt from examples/textual_inversion/te…
mnoukhov Feb 8, 2024
d643b66
Add vae tiling and slicing in img2img and inpaint (#6871)
MrSyee Feb 8, 2024
e6c9c25
fix examples/community/pipeline_stable_diffusion_xl_instantid.py (#6759)
shaoxiaowang Feb 8, 2024
db5194a
Fix Compatibility Issues in stable_diffusion_xl_reference.py (#6251)
HenryQUQ Feb 8, 2024
a83cc0c
Standardize model card for Controlnet flax (#6909)
bamps53 Feb 9, 2024
f07899a
Standardize model card for Controlnet SDXL (#6908)
bamps53 Feb 9, 2024
7337eea
[refactor] unnecessary lines in decode_latents in video pipelines (#6…
a-r-r-o-w Feb 9, 2024
159885a
correct hub_token exposition behaviour (thanks to @bghira). (#6918)
sayakpaul Feb 9, 2024
59c307f
Standardize model card for Controlnet (#6910)
bamps53 Feb 9, 2024
ab71134
More IPAdapter test fixes (#6888)
DN6 Feb 9, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion PHILOSOPHY.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<!---
Copyright 2023- The HuggingFace Team. All rights reserved.
Copyright 2024- The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion docs/TRANSLATING.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/activations.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/attnprocessor.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/configuration.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/image_processor.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/internal_classes_overview.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/loaders/ip_adapter.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/loaders/lora.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/loaders/peft.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/loaders/single_file.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/loaders/textual_inversion.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/loaders/unet.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/logging.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/asymmetricautoencoderkl.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/autoencoder_tiny.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/autoencoderkl.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/controlnet.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/overview.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/prior_transformer.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/transformer2d.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/transformer_temporal.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/unet-motion.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/unet.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/unet2d-cond.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/unet2d.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/unet3d-cond.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/models/vq.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/normalization.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/outputs.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/amused.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/animatediff.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/attend_and_excite.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/audioldm.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/audioldm2.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/auto_pipeline.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/blip_diffusion.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/consistency_models.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/controlnet.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/controlnet_sdxl.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/dance_diffusion.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/ddim.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/ddpm.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/deepfloyd_if.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/diffedit.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/dit.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand Down
14 changes: 7 additions & 7 deletions docs/source/en/api/pipelines/i2vgenxl.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
Expand All @@ -18,11 +18,11 @@ The abstract from the paper is:

*Video synthesis has recently made remarkable strides benefiting from the rapid development of diffusion models. However, it still encounters challenges in terms of semantic accuracy, clarity and spatio-temporal continuity. They primarily arise from the scarcity of well-aligned text-video data and the complex inherent structure of videos, making it difficult for the model to simultaneously ensure semantic and qualitative excellence. In this report, we propose a cascaded I2VGen-XL approach that enhances model performance by decoupling these two factors and ensures the alignment of the input data by utilizing static images as a form of crucial guidance. I2VGen-XL consists of two stages: i) the base stage guarantees coherent semantics and preserves content from input images by using two hierarchical encoders, and ii) the refinement stage enhances the video's details by incorporating an additional brief text and improves the resolution to 1280×720. To improve the diversity, we collect around 35 million single-shot text-video pairs and 6 billion text-image pairs to optimize the model. By this means, I2VGen-XL can simultaneously enhance the semantic accuracy, continuity of details and clarity of generated videos. Through extensive experiments, we have investigated the underlying principles of I2VGen-XL and compared it with current top methods, which can demonstrate its effectiveness on diverse data. The source code and models will be publicly available at [this https URL](https://i2vgen-xl.github.io/).*

The original codebase can be found [here](https://github.com/ali-vilab/i2vgen-xl/). The model checkpoints can be found [here](https://huggingface.co/ali-vilab/).
The original codebase can be found [here](https://github.com/ali-vilab/i2vgen-xl/). The model checkpoints can be found [here](https://huggingface.co/ali-vilab/).

<Tip>

Make sure to check out the Schedulers [guide](../../using-diffusers/schedulers) to learn how to explore the tradeoff between scheduler speed and quality, and see the [reuse components across pipelines](../../using-diffusers/loading#reuse-components-across-pipelines) section to learn how to efficiently load the same components into multiple pipelines. Also, to know more about reducing the memory usage of this pipeline, refer to the ["Reduce memory usage"] section [here](../../using-diffusers/svd#reduce-memory-usage).
Make sure to check out the Schedulers [guide](../../using-diffusers/schedulers) to learn how to explore the tradeoff between scheduler speed and quality, and see the [reuse components across pipelines](../../using-diffusers/loading#reuse-components-across-pipelines) section to learn how to efficiently load the same components into multiple pipelines. Also, to know more about reducing the memory usage of this pipeline, refer to the ["Reduce memory usage"] section [here](../../using-diffusers/svd#reduce-memory-usage).

</Tip>

Expand All @@ -31,7 +31,7 @@ Sample output with I2VGenXL:
<table>
<tr>
<td><center>
masterpiece, bestquality, sunset.
library.
<br>
<img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/i2vgen-xl-example.gif"
alt="library"
Expand All @@ -43,9 +43,9 @@ Sample output with I2VGenXL:
## Notes

* I2VGenXL always uses a `clip_skip` value of 1. This means it leverages the penultimate layer representations from the text encoder of CLIP.
* It can generate videos of quality that is often on par with [Stable Video Diffusion](../../using-diffusers/svd) (SVD).
* Unlike SVD, it additionally accepts text prompts as inputs.
* It can generate higher resolution videos.
* It can generate videos of quality that is often on par with [Stable Video Diffusion](../../using-diffusers/svd) (SVD).
* Unlike SVD, it additionally accepts text prompts as inputs.
* It can generate higher resolution videos.
* When using the [`DDIMScheduler`] (which is default for this pipeline), less than 50 steps for inference leads to bad results.

## I2VGenXLPipeline
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/kandinsky.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/api/pipelines/kandinsky3.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
<!--Copyright 2024 The HuggingFace Team. All rights reserved.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Expand Down
Loading
Loading