Skip to content

Commit

Permalink
Merge pull request #197 from logzio/s3-update
Browse files Browse the repository at this point in the history
Update aws-s3-bucket.md
  • Loading branch information
Doron-Bargo authored Sep 5, 2023
2 parents c30ad06 + 23979e5 commit 756a02f
Showing 1 changed file with 13 additions and 12 deletions.
25 changes: 13 additions & 12 deletions docs/shipping/AWS/aws-s3-bucket.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,10 +23,21 @@ These instructions support collecting logs and metrics from S3 bucket
Some AWS services can be configured to ship their logs to an S3 bucket, where Logz.io can fetch those logs directly.


### Which shipping method is right for you

* If your data is organized in alphabetical order, you should opt for the [S3 fetcher](#shipping-logs-via-s3-fetcher). Logz.io operates this fetcher on our end, directly accessing your S3 to retrieve the data.


* If your data is not organized in alphabetical order, use the [S3 hook](#shipping-logs-via-s3-hook). This approach requires deploying a Lambda function within your environment to manage the process.


### Shipping logs via S3 Fetcher

:::note
In case your S3 bucket is encrypted, you need to add `kms:Decrypt` to the policy on the ARN of the KMS key used to encrypt the bucket.
:::
### Best practices

#### Best practices

The S3 API does not allow retrieval of object timestamps, so Logz.io must collect logs in alphabetical order.
Please keep these notes in mind when configuring logging.
Expand All @@ -43,19 +54,9 @@ Please keep these notes in mind when configuring logging.
To guarantee successful file upload, make sure that the size of each log file does not exceed 50 MB.


### Which shipping method is right for you

* If your data is organized in alphabetical order, you should opt for the [S3 fetcher](#shipping-logs-via-s3-fetcher). Logz.io operates this fetcher on our end, directly accessing your S3 to retrieve the data.


* If your data is not organized in alphabetical order, use the [S3 hook](#shipping-logs-via-s3-hook). This approach requires deploying a Lambda function within your environment to manage the process.


### Shipping logs via S3 Fetcher


#### Configure Logz.io to fetch logs from an S3 bucket


##### Add a new S3 bucket using the dedicated Logz.io configuration wizard

Expand Down

0 comments on commit 756a02f

Please sign in to comment.