Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

S3 note #182

Merged
merged 1 commit into from
Sep 4, 2023
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 3 additions & 21 deletions docs/shipping/AWS/aws-s3-bucket.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,30 +39,12 @@ Please keep these notes in mind when configuring logging.
To guarantee successful file upload, make sure that the size of each log file does not exceed 50 MB.


### Log Shipping Methods Comparison for S3
### Which shipping method is right for you

#### Setup using IAM roles
* If your data is organized in alphabetical order, you should opt for the S3 fetcher. Logz.io operates this fetcher on our end, directly accessing your S3 to retrieve the data.

**Pros:**
- **Security**: Does not require sharing or storing permanent AWS credentials.
- **Delegation**: Can assign fine-grained permissions and roles, providing flexibility.
- **Auditability**: IAM roles provide better traceability of access.

**Cons:**
- **Complexity**: Might be slightly complex for users unfamiliar with AWS IAM roles.
- **Maintenance**: Might require occasional maintenance if AWS policies or permissions change.

#### Setup using access keys

**Pros:**
- **Simplicity**: Straightforward for those familiar with AWS as it uses the basic access and secret keys.
- **Direct Access**: Provides direct access without the need for role assumption or extra configuration.

**Cons:**
- **Security Risks**: If keys are compromised, they provide direct access unless they're revoked.
- **Management Overhead**: Requires secure storage and periodic rotation of keys.
- **Limited Traceability**: Harder to trace specific actions to individual users or services, as keys can be shared.

* If your data is not organized in alphabetical order, use the S3 hook. This approach requires deploying a Lambda function within your environment to manage the process.


### Shipping logs via S3 Fetcher
Expand Down