-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[dagster-fivetran] Scaffold FivetranWorkspace for rework #25750
base: master
Are you sure you want to change the base?
Conversation
This stack of pull requests is managed by Graphite. Learn more about stacking. Join @maximearmstrong and the rest of your teammates on Graphite |
00edd81
to
8c291f8
Compare
return {"content_type": self.content_type.value, "properties": self.properties} | ||
|
||
@classmethod | ||
def from_cached_data(cls, data: Mapping[Any, Any]) -> "FivetranContentData": |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why is this one necessary? Feel like this class should just be @whitelist_for_serdes
if we need to cache.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the feedback!
This was the original pattern for Power BI, but I see that it was updated to use @whitelist_for_serdes
since then.
I based my pattern here on the Tableau integration, which was not updated to use @whitelist_for_serdes
yet.
Changes for this PR made in 4dfe34d, I will also update Tableau in another PR.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Comment, otherwise lgtm
|
||
_client: FivetranClient = PrivateAttr(default=None) | ||
|
||
def get_client(self) -> FivetranClient: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Curious what the motivation for separating out the client is here - just to separate out the workspace loading and the actual API interactions?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Exactly - this is the current pattern for Tableau and Looker.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Makes sense to me 👍
8c291f8
to
4dfe34d
Compare
Summary & Motivation
Builds out a very barebones resource and client classes for the new version of the Fivetran integration.
How I Tested These Changes
Tests will be added in subsequent PRs.