Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(image-to-video): integrate NSFW safety checker #90

Merged
merged 2 commits into from
May 31, 2024

Conversation

ad-astra-video
Copy link
Collaborator

This PR integrates the CompVis/stable-diffusion-safety-checker into the image-to-video pipeline.

The safety check is done on the input image of the request with the result carried through to the response. At this time, the

Similar to the text-to-image and image-to-image implementations the Orchestrator can opt to perform the safety check on the CPU using the SAFETY_CHECKER_DEVICE environment variable to conserve VRAM. CPU processing will be slower than GPU but is up to the orchestrator to determine what is best to serve the request.

See text-to-image PR for performance results.

@rickstaa rickstaa force-pushed the av-image-to-video-safety-check branch from a03f262 to 893707e Compare May 31, 2024 09:42
This commit applies the black formatter onto the codebase.
Copy link
Member

@rickstaa rickstaa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thanks!

@rickstaa rickstaa merged commit a34622e into livepeer:main May 31, 2024
1 check passed
eliteprox pushed a commit to eliteprox/ai-worker that referenced this pull request Jun 9, 2024
* add saftey checker to image to video

* refactor(runner): apply black formatter

This commit applies the black formatter onto the codebase.

---------

Co-authored-by: Rick Staa <[email protected]>
@ad-astra-video ad-astra-video deleted the av-image-to-video-safety-check branch July 25, 2024 01:59
eliteprox pushed a commit to eliteprox/ai-worker that referenced this pull request Jul 26, 2024
* add saftey checker to image to video

* refactor(runner): apply black formatter

This commit applies the black formatter onto the codebase.

---------

Co-authored-by: Rick Staa <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants