Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: RedisStore ID not maintained across operations in the same job so sync_op can't find the nodes in Redis #2

Open
BeArchiTek opened this issue Mar 6, 2024 · 0 comments

Comments

@BeArchiTek
Copy link
Contributor

Current Behavior

When running the sync job. The Store ID set during the load_source and load_destination seems not to be maintained. When logging out the IDs in the sync operation, the IDs are different.

This is causing the potenda.diff() not to find any difference because not nodes/modesl can be load.

Expected Behavior

Be able to load the source and destination outside the sync operation for faster operations/parallelism

Steps to Reproduce

  • start the dagster instance
  • run the generate job
  • run the sync job
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant