Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Why do you use the GLOW design? #1

Open
mjack3 opened this issue Apr 20, 2022 · 2 comments
Open

Why do you use the GLOW design? #1

mjack3 opened this issue Apr 20, 2022 · 2 comments

Comments

@mjack3
Copy link

mjack3 commented Apr 20, 2022 •
edited
Loading

Hello. Is good to know that there's people trying to reproduce this work. I'm also working on it.
@jankenshow
Copy link
Contributor

jankenshow commented May 10, 2022 •
edited
Loading

Thank you for your comment and sorry for late reply.
I saw your repo working on FastFlow reproduction and using AllInOneBlock as backend.

There are mainly two reasons why we choose GLOW design.
First, according to the paper, FastFlow block has an activation normalization layer followed by channel permute layer, and consequent two "coupling layers”. We assume this is the very architecture of GLOW.
Second, GLOW could stabilize learning phase in our environment.

We would be happy to hear your views on this.

@mjack3
Copy link
Author

mjack3 commented May 10, 2022 •
edited
Loading

Hello, I agree with you. I used GLOW after having studied this in deep with 1.2 clamping. and results turned up very good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jankenshow @mjack3