ERROR Unable to get next page. Continuing with next page. Cause: operation error DynamoDB: Scan, request canceled,

[elonderin]

i ran this:

$ ddbt --no-input MY_TABLE

and got CLI spammed with the last 2 lines repeating forever:

  DEBUG   Retrieving table information for table MY_TABLE
  DEBUG   DescribeTableInput: {"TableName":"MY_TABLE"}
  DEBUG   DescribeTableOutput: {"Table":{"ArchivalSummary":null,"AttributeDefinitions":[{"AttributeName":"itemId","AttributeType":"S"},{"AttributeName":"roomTypeId","AttributeType":"S"}],"BillingModeSummary":{"BillingMode":"PAY_PER_REQUEST","LastUpdateToPayPerRequestDateTime":"2021-04-27T07:59:53.337Z"},"CreationDateTime":"2021-04-27T07:59:53.337Z","GlobalSecondaryIndexes":[{"Backfilling":null,"IndexArn":"arn:aws:dynamodb:eu-central-1:00000000000:table/MY_TABLE/index/roomTypeId","IndexName":"roomTypeId","IndexSizeBytes":223226191,"IndexStatus":"ACTIVE","ItemCount":7668,"KeySchema":[{"AttributeName":"roomTypeId","KeyType":"HASH"}],"Projection":{"NonKeyAttributes":null,"ProjectionType":"ALL"},"ProvisionedThroughput":{"LastDecreaseDateTime":null,"LastIncreaseDateTime":null,"NumberOfDecreasesToday":0,"ReadCapacityUnits":0,"WriteCapacityUnits":0}}],"GlobalTableVersion":null,"ItemCount":7668,"KeySchema":[{"AttributeName":"itemId","KeyType":"HASH"}],"LatestStreamArn":null,"LatestStreamLabel":null,"LocalSecondaryIndexes":null,"ProvisionedThroughput":{"LastDecreaseDateTime":null,"LastIncreaseDateTime":null,"NumberOfDecreasesToday":0,"ReadCapacityUnits":0,"WriteCapacityUnits":0},"Replicas":null,"RestoreSummary":null,"SSEDescription":{"InaccessibleEncryptionDateTime":null,"KMSMasterKeyArn":"arn:aws:kms:eu-central-1:00000000000:key/7648138b-9bd0-454b-bea3-6f72ce3da195","SSEType":"KMS","Status":"ENABLED"},"StreamSpecification":null,"TableArn":"arn:aws:dynamodb:eu-central-1:00000000000:table/MY_TABLE","TableId":"028c709f-fcec-44a6-8efc-7a03b08f1217","TableName":"MY_TABLE","TableSizeBytes":223226191,"TableStatus":"ACTIVE"},"ResultMetadata":{}}
  DEBUG   Start segment 0 of 4
  DEBUG   Start segment 1 of 4
  DEBUG   Start segment 2 of 4
  DEBUG   Start segment 3 of 4
▀  Truncating table arn:aws:dynamodb:eu-central-1:00000000000:table/MY_TABLE  DEBUG   Start processing segment 3
  DEBUG   Start processing segment 0
  DEBUG   Start processing segment 2
  DEBUG   Start processing segment 1
  DEBUG   ScanInput: {"TableName":"MY_TABLE","AttributesToGet":null,"ConditionalOperator":"","ConsistentRead":null,"ExclusiveStartKey":null,"ExpressionAttributeNames":{"#0":"itemId"},"ExpressionAttributeValues":null,"FilterExpression":null,"IndexName":null,"Limit":null,"ProjectionExpression":"#0","ReturnConsumedCapacity":"TOTAL","ScanFilter":null,"Segment":3,"Select":"","TotalSegments":4}
  DEBUG   ScanInput: {"TableName":"MY_TABLE","AttributesToGet":null,"ConditionalOperator":"","ConsistentRead":null,"ExclusiveStartKey":null,"ExpressionAttributeNames":{"#0":"itemId"},"ExpressionAttributeValues":null,"FilterExpression":null,"IndexName":null,"Limit":null,"ProjectionExpression":"#0","ReturnConsumedCapacity":"TOTAL","ScanFilter":null,"Segment":0,"Select":"","TotalSegments":4}
  DEBUG   ScanInput: {"TableName":"MY_TABLE","AttributesToGet":null,"ConditionalOperator":"","ConsistentRead":null,"ExclusiveStartKey":null,"ExpressionAttributeNames":{"#0":"itemId"},"ExpressionAttributeValues":null,"FilterExpression":null,"IndexName":null,"Limit":null,"ProjectionExpression":"#0","ReturnConsumedCapacity":"TOTAL","ScanFilter":null,"Segment":1,"Select":"","TotalSegments":4}
  DEBUG   ScanInput: {"TableName":"MY_TABLE","AttributesToGet":null,"ConditionalOperator":"","ConsistentRead":null,"ExclusiveStartKey":null,"ExpressionAttributeNames":{"#0":"itemId"},"ExpressionAttributeValues":null,"FilterExpression":null,"IndexName":null,"Limit":null,"ProjectionExpression":"#0","ReturnConsumedCapacity":"TOTAL","ScanFilter":null,"Segment":2,"Select":"","TotalSegments":4}
▀  Truncating table arn:aws:dynamodb:eu-central-1:00000000000:table/MY_TABLE  ERROR   Unable to get next page. Continuing with next page. Cause: operation error DynamoDB: Scan, request canceled, context canceled
└ (/home/runner/work/ddbt/ddbt/cmd/ddbt/main.go:234)
  ERROR   Unable to get next page. Continuing with next page. Cause: operation error DynamoDB: Scan, request canceled, context canceled
└ (/home/runner/work/ddbt/ddbt/cmd/ddbt/main.go:234)
....

[elonderin]

for security i renamed the account no and the table name

[elonderin]

• the table has dynamic capacity
• i saw some "throttled requests" in the monitoring

[jenslauterbach]

@elonderin Thank you for reporting this issue. Can you please provide more information. You could for example run the following command (using the AWS CLI):

aws dynamodb describe-table --table-name MY_TABLE --region eu-central-1

This should contain more information. And don't forget to remove data you don't want to share.

I will somehow need to try and replicate the issue and need as much info as possible.