-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DDSaaS: StreamNative: Crawler Integration v1.0.0 #18782
base: master
Are you sure you want to change the base?
Changes from 19 commits
7137dad
f34e5c9
462c200
c8f5029
2fcd238
0a338ca
19eb166
f405191
9e4ec3a
8da2014
6f70e58
001b23e
16f0cfb
0d4c180
587acd1
a6fa123
cd2f120
7666e7a
64fbe4e
e39ece2
5b321b7
462056e
82ef7d7
435e804
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
# CHANGELOG - StreamNative | ||
|
||
## 1.0.0 / 2024-10-01 | ||
|
||
***Added***: | ||
|
||
* Initial Release |
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,73 @@ | ||
# StreamNative | ||
|
||
## Overview | ||
|
||
[StreamNative][1] provides an enterprise-grade messaging and event streaming platform built on Apache Pulsar. It offers scalable, real-time data streaming solutions with features like multi-tenancy, geo-replication, and seamless integration with cloud services. | ||
|
||
The StreamNative integration collects the below types of [metrics][2]: | ||
|
||
1. Health | ||
2. Pulsar Resource | ||
3. Source Connector | ||
4. Sink Connector | ||
5. Kafka Connect | ||
|
||
## Setup | ||
|
||
### Configuration | ||
|
||
#### Get StreamNative Credentials | ||
jhgilbert marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
||
##### Login to the [StreamNative Cloud Console Account][3]. | ||
jhgilbert marked this conversation as resolved.
Show resolved
Hide resolved
|
||
##### Get the `Organization ID` and `Instance Name`: | ||
1. Click the profile icon and select the **Organizations** option. | ||
2. Select the **Organization** for which data needs to be collected. | ||
3. Obtain the **Instance Name** from the **Select an Instance** dropdown. | ||
##### Get the `Client ID` and `Client Secret`: | ||
1. Click the profile icon and select the **Accounts & Accesses** tab. | ||
2. Select the Service Account for which **Admin** permission is **Enabled**. | ||
3. If the Service Account does not exist, click on **New -> Service Account** to create a new one, and ensure the **Super Admin** option is enabled. | ||
4. Click on the `...` button on the right side of the selected Service Account. | ||
5. Click **Download OAuth2 Key** to get the **Client ID** and **Client Secret**. | ||
|
||
|
||
#### Add StreamNative Credentials | ||
jhgilbert marked this conversation as resolved.
Show resolved
Hide resolved
jhgilbert marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
||
- Organization ID | ||
- Instance Name | ||
- Client ID | ||
- Client Secret | ||
|
||
|
||
## Data Collected | ||
jhgilbert marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
||
### Logs | ||
|
||
The StreamNative integration does not include any logs. | ||
|
||
### Metrics | ||
|
||
The StreamNative integration collects and forwards the following metrics to Datadog. | ||
|
||
1. Health | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. @apiazza-dd is this where we should have the table view with all the metric names + descriptions for the public docs? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The Metrics section on the public docs should reflect a table view of all the metrics collected that show up on the "Data collected" tab on the tile (from the metadata.csv) There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Please see comment above |
||
2. Pulsar Resource | ||
3. Source Connector | ||
4. Sink Connector | ||
5. Kafka Connect | ||
|
||
### Service Checks | ||
|
||
The StreamNative integration does not include any service checks. | ||
|
||
### Events | ||
|
||
The StreamNative integration does not include any events. | ||
|
||
## Troubleshooting | ||
|
||
Need help? Contact [Datadog support][4]. | ||
|
||
[1]: https://streamnative.io/ | ||
[2]: https://docs.streamnative.io/docs/cloud-metrics-api#metrics-endpoint | ||
[3]: https://console.streamnative.cloud/ | ||
[4]: https://docs.datadoghq.com/help/ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"collects the below" > Collects the following types of metrics
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done.