Create Builder Stack Failed

[mmarzillo]

Hi There,

I tried to deploy this AWS template and I'm getting the below error, I could be configuring something wrong, but it seems pretty straightforward so maybe not?

[mmarzillo]

Hi There @dylan-tong-aws,

So after poking around a bit it looks like the root failure is due the size of the data being passed by the lambda function (it's exceeding 4k). Below is the data the that's being passed by the function, I suppose the question is whether or not this needs to be passed or whether or not the code in the function can be changed to truncate the response.

2022-04-14T08:05:11.948-05:00

Copy
{
"Status": "SUCCESS",
"Reason": "See the details in CloudWatch Log Stream: 2022/04/14/[$LATEST]b27c7d761a454c3fa056abc99c88b97f",
"PhysicalResourceId": "2022/04/14/[$LATEST]b27c7d761a454c3fa056abc99c88b97f",
"StackId": "arn:aws:cloudformation:us-west-2:475157722183:stack/snowflake-sagemaker-credit-risk-workshop-BuildAndPubKernelBuilder-KernelPublisherStack-9W0L43JGYCHT/504307e0-bbf3-11ec-97dd-021e3c564a2d",
"RequestId": "2e3bf6ff-a682-4d19-8564-76b4e9fa39e5",
"LogicalResourceId": "KernelPublishWorkflow",
"NoEcho": false,
"Data": {
"Results": "{"create_image": {"CreationTime": "2022-04-13 13:03:50.890000+00:00", "ImageArn": "arn:aws:sagemaker:us-west-2:475157722183:image/snowflake-workshop", "ImageName": "snowflake-workshop", "ImageStatus": "CREATED", "LastModifiedTime": "2022-04-14 13:04:25.627000+00:00", "RoleArn": "arn:aws:iam::475157722183:role/kb-sm-exec--021e3c564a2d", "ResponseMetadata": {"RequestId": "47d912fa-a2d7-459e-bd47-2fec81968b3e", "HTTPStatusCode": 200, "HTTPHeaders": {"x-amzn-requestid": "47d912fa-a2d7-459e-bd47-2fec81968b3e", "content-type": "application/x-amz-json-1.1", "content-length": "272", "date": "Thu, 14 Apr 2022 13:04:39 GMT"}, "RetryAttempts": 0}}, "create_image_ver": {"BaseImage": "475157722183.dkr.ecr.us-west-2.amazonaws.com/sagemaker-snowflake-workshop:snowflake-workshop", "ContainerImage": "475157722183.dkr.ecr.us-west-2.amazonaws.com/sagemaker-snowflake-workshop@sha256:b90aae1c501962bf850e49666d6cd173065baae99c03cb1654e315b9b5f9e0dc", "CreationTime": "2022-04-14 13:04:41.250000+00:00", "ImageArn": "arn:aws:sagemaker:us-west-2:475157722183:image/snowflake-workshop", "ImageVersionArn": "arn:aws:sagemaker:us-west-2:475157722183:image-version/snowflake-workshop/3", "ImageVersionStatus": "CREATED", "LastModifiedTime": "2022-04-14 13:04:41.642000+00:00", "Version": 3, "ResponseMetadata": {"RequestId": "1b412c97-108d-4a16-be88-b567495d24d5", "HTTPStatusCode": 200, "HTTPHeaders": {"x-amzn-requestid": "1b412c97-108d-4a16-be88-b567495d24d5", "content-type": "application/x-amz-json-1.1", "content-length": "558", "date": "Thu, 14 Apr 2022 13:04:56 GMT"}, "RetryAttempts": 0}}, "config_app_image": {"AppImageConfigArn": "arn:aws:sagemaker:us-west-2:475157722183:app-image-config/snowflake-workshop-config", "ResponseMetadata": {"RequestId": "1049cb70-37df-40cc-b758-68bf5a0adf9f", "HTTPStatusCode": 200, "HTTPHeaders": {"x-amzn-requestid": "1049cb70-37df-40cc-b758-68bf5a0adf9f", "content-type": "application/x-amz-json-1.1", "content-length": "107", "date": "Thu, 14 Apr 2022 13:04:56 GMT"}, "RetryAttempts": 0}}, "update_domain": {"DomainArn": "arn:aws:sagemaker:us-west-2:475157722183:domain/d-b91m7168srq5", "DomainId": "d-b91m7168srq5", "DomainName": "default-1649771086672", "HomeEfsFileSystemId": "fs-06f858b96f05bcebc", "Status": "InService", "CreationTime": "2022-04-12 13:44:50.658000+00:00", "LastModifiedTime": "2022-04-14 13:04:58.481000+00:00", "AuthMode": "IAM", "DefaultUserSettings": {"ExecutionRole": "arn:aws:iam::475157722183:role/service-role/AmazonSageMaker-ExecutionRole-20220408T171208", "SharingSettings": {"NotebookOutputOption": "Allowed", "S3OutputPath": "s3://sagemaker-studio-475157722183-gk3lg11ix9b/sharing"}, "KernelGatewayAppSettings": {"CustomImages": [{"ImageName": "snowflake-workshop", "ImageVersionNumber": 3, "AppImageConfigName": "snowflake-workshop-config"}]}}, "AppNetworkAccessType": "PublicInternetOnly", "SubnetIds": ["subnet-08d29e473f790d31f", "subnet-029ee3f854eabf5c5", "subnet-0271b0f37f2d2b972", "subnet-050a938e57c00149d"], "Url": "https://d-b91m7168srq5.studio.us-west-2.sagemaker.aws\", "VpcId": "vpc-09d9694839320405e", "ResponseMetadata": {"RequestId": "3cabff1b-0606-4028-a52a-0f66a703b2f5", "HTTPStatusCode": 200, "HTTPHeaders": {"x-amzn-requestid": "3cabff1b-0606-4028-a52a-0f66a703b2f5", "content-type": "application/x-amz-json-1.1", "content-length": "1004", "date": "Thu, 14 Apr 2022 13:05:11 GMT"}, "RetryAttempts": 0}}}"
}
}

[temiwale88]

Hello,

I'm getting a similar issue (2x now) after following the guide: https://quickstarts.snowflake.com/guide/vhol_snowflake_data_wrangler/index.html#2

Can someone please update the CF template?

Thanks.

[mmarzillo]

Hi @temiwale88, I never completely nailed down the root cause of the problem, but I believe it was related to limits on my account. My initial AWS account was with a commercial email address and when I set up an account with my @gmail account it deployed successfully. I parse through some of the limits and couldn't nail down the exact issue, but my hunch is that AWS imposes different limits based on the email address you use to set up the account... try setting up another, fresh account and see what you get.

[DioMou]

Good solution, it works for me

Hi @temiwale88, I never completely nailed down the root cause of the problem, but I believe it was related to limits on my account. My initial AWS account was with a commercial email address and when I set up an account with my @gmail account it deployed successfully. I parse through some of the limits and couldn't nail down the exact issue, but my hunch is that AWS imposes different limits based on the email address you use to set up the account... try setting up another, fresh account and see what you get.