You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The description param, used by RedshiftSpectrum.from_df() when calling wr.s3.to_parquet(), is deprecated in awswrangler v3.0. Since users depend on this parameter, we should have unit tests failing when upgrading awswrangler.
Tasks
Add a unit test which catches this deprecation (in case eg. someone wants to upgrade awswrangler). In other words, the test should use the description param.
Currently in the viadot 2.0 requirements we have stiff version of the lib awsrangler==2.20.1 , however in the version newer than 3.0 parameter description get obsolete.
We have this parameter in the workflow beginning from the deployment file.
Description - triaged
The
description
param, used byRedshiftSpectrum.from_df()
when callingwr.s3.to_parquet()
, is deprecated inawswrangler
v3.0. Since users depend on this parameter, we should have unit tests failing when upgradingawswrangler
.Tasks
awswrangler
). In other words, the test should use thedescription
param.NOTE: WIP was added in #917 (075b333)
Original description
Currently in the viadot 2.0 requirements we have stiff version of the lib
awsrangler==2.20.1
, however in the version newer than3.0
parameterdescription
get obsolete.We have this parameter in the workflow beginning from the deployment file.
For example:
`from templates import extract_and_load_sharepoint
URL = "https:/xxx.sharepoint.com/sites/DACN/doku%20comp/General/Source_data/EUMapping.xlsx"
extract_and_load_sharepoint(
table="sp_eumapping",
sharepoint_url=URL,
sheet_name="Sheet1",
description="Sharepoint file: " + URL,
sharepoint_credentials_secret="sharepointsecret2",
schedule="0 8 * * *",
)`
The text was updated successfully, but these errors were encountered: