Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DiffEdit: Editing Images using Generative AI #142

Merged
merged 6 commits into from
Dec 14, 2023
Merged

DiffEdit: Editing Images using Generative AI #142

merged 6 commits into from
Dec 14, 2023

Conversation

JonnySpruce
Copy link
Contributor

This is a blog post put together by myself and @jstrong-scottlogic, as part of the bench project on Practical Deep Learning for Coders.

Please add a direct link to your post here:

https://jonnyspruce.github.io/blog/2023/12/13/diffedit.html

Have you (please tick each box to show completion):

  • Added your blog post to a single category?
  • Added a brief summary for your post? Summaries should be roughly two sentences in length and give potential readers a good idea of the contents of your post.
  • Checked that the build passes?
  • Checked your spelling (you can use npm spellcheck if that's your thing)
  • Ensured that your author profile contains a profile image, and a brief description of yourself? (make it more interesting than just your job title!)
  • Optimised any images in your post? They should be less than 100KBytes as a general guide.

Note: a couple of images are still above 100KB (>200KB however) - let me know if this needs to be reduced further.

Category:

  • Artificial Intelligence - Chris Price has reviewed this blog post multiple times during writing, and suggested that I ask @ColinEberhardt for final review.

ColinEberhardt
ColinEberhardt requested changes Dec 14, 2023
View reviewed changes
Copy link
Contributor

@ColinEberhardt ColinEberhardt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great post, thanks - one small issue to resolve.

_posts/2023-12-13-diffedit.md
The DiffEdit paper utilises the noise prediction which a diffusion model provides to us to automatically limit edits to certain parts of an image. It does this in three main steps which are summarised in the pipeline chart below:


![svg]({{ site.github.url }}/jspruce/assets/diffedit_steps.svg "DiffEdit pipeline steps")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a broken link, currently the file sits in the _posts folder:

image

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for spotting that - should be resolved now!

@ColinEberhardt ColinEberhardt merged commit bc956cf into ScottLogic:gh-pages Dec 14, 2023
1 check passed
@ColinEberhardt
Copy link
Contributor

Thanks @JonnySpruce @jstrong-scottlogic - great post, just merged

dsmithsl pushed a commit to dsmithsl/blog that referenced this pull request Jan 9, 2024
@JonnySpruce @dsmithsl
DiffEdit: Editing Images using Generative AI (ScottLogic#142)
aa0c7bc 
* add diffedit blog post

* edit author desription and remove image from metadata

* remove additional code formatting

* update digram to be more vertical

* change image sizes

* move svg to correct place
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ColinEberhardt ColinEberhardt ColinEberhardt requested changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@JonnySpruce @ColinEberhardt