-
Notifications
You must be signed in to change notification settings - Fork 2.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore(ingest/tableau): miscellaneous cleanup refractor #8417
chore(ingest/tableau): miscellaneous cleanup refractor #8417
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
All nice changes, thanks for doing this! I think I see one functional code change.
Also, these tableau goldens are absurd lol. Would be nice to get some stripped down ones that are actually reviewable
schema = table.get(tableau_constant.SCHEMA, "") | ||
table_name = table.get(tableau_constant.NAME, "") | ||
full_name = table.get(tableau_constant.FULL_NAME, "") | ||
schema = table.get(tableau_constant.SCHEMA) or "" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is it possible table[NAME] == None
? Just curious on the reason for these changes, overall I'm happy with them
tableau_constant.EXTRACT_LAST_UPDATE_TIME, "" | ||
) | ||
or "", | ||
tableau_constant.TYPE: datasource.get(tableau_constant.TYPE_NAME, ""), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We're fetching key TYPE_NAME
but only TYPE
in the new code
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nice catch.
So it fetches the key named "__typename" from dictionary and adds it to custom props with key "type". I believe, it is okay to keep __typename as key in custom dict OR remove this key entirely , as the type of datasource is captured in subtype.
Merging as this shouldn't affect smoke tests and it seems like the failures were due to the tests taking too long... gonna try one more time first |
Checklist