Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support s3 directories with more than 1000 keys #314

Open
andrewresnikoff opened this issue Apr 6, 2021 · 0 comments · May be fixed by #315
Open

support s3 directories with more than 1000 keys #314

andrewresnikoff opened this issue Apr 6, 2021 · 0 comments · May be fixed by #315

Comments

@andrewresnikoff
Copy link

Each list-objects-v2 API call only returns 1000 keys at a time as per the AWS Docs.

Returns some or all (up to 1,000) of the objects in a bucket.

When there are more than 1000 keys, we get back NextContinuationToken

NextContinuationToken is sent when isTruncated is true, which means there are more keys in the bucket that can be listed. The next list requests to Amazon S3 can be continued with this NextContinuationToken . NextContinuationToken is obfuscated and is not a real key

to paginate the remaining results.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

support s3 directories with more than 1000 keys andrewresnikoff/commuter
1 participant
@andrewresnikoff