Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem: priority calculation of a transition #4

Open
Vinson-sheep opened this issue Aug 30, 2021 · 0 comments
Open

problem: priority calculation of a transition #4

Vinson-sheep opened this issue Aug 30, 2021 · 0 comments

Comments

@Vinson-sheep
Copy link

I have read the paper and code of your project, and I have a modest doubt in terms of the realization of calculating priority. In the code, actor_loss_element = self.critic_model.predict([cur_states, predicted_actions]) correspond to term 2 of priority formulation (8) in the paper. Obviously, this term should be related to a list of gradients in the paper, but not in the code. I think for a long time and find no answer, can you give me an explanation, or it is just a bug? Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant