Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MidU Timestep tests #20

Open
shahbuland opened this issue May 6, 2023 · 0 comments
Open

MidU Timestep tests #20

shahbuland opened this issue May 6, 2023 · 0 comments

Comments

@shahbuland
Copy link
Contributor

Could be a bug with timestep embeddings for the MidU reward model

  • Currently it is taking only denoised images, in the future we want to try noisy images so that it can give reward for in-progress generations (steering in different stages could help in different ways)
  • Have to walk before we can run so for now just working with purely denoised images
  • Time steps need to reflect that the images are entirely denoised
  • Currently not sure if timestep input is signifying pure signal or pure noise (using a value of 0)
  • Need to get a better dataset to test on
  • To validate the other code is working, will need to get good results on said dataset with CLIP RM model first
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant