Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spinnaker integration #19020

Open
wants to merge 67 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 60 commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
a791717
Vonage:Assets PR
yogesh-s-modak Nov 7, 2024
3299b72
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
c2b9c2e
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
8172e51
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
e610e57
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
1ce923c
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
6bd54cb
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
67d8cb4
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
cadc4e2
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
594bc62
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
3f6f9f0
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
b4d692b
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
a51ad8a
Vonage:Assets PR V2
yogesh-s-modak Nov 7, 2024
fde1c7a
Vonage:Assets PR V3
yogesh-s-modak Nov 8, 2024
3fb2308
Vonage:Assets PR V3
yogesh-s-modak Nov 8, 2024
3514af3
Vonage:Assets PR V3
yogesh-s-modak Nov 8, 2024
ce961cf
Spinnaker Integration: V1
yogesh-s-modak Nov 8, 2024
fe6fbf1
Spinnaker Integration:V2
yogesh-s-modak Nov 12, 2024
8f48fd2
Spinnaker Integration:V2
yogesh-s-modak Nov 12, 2024
bb0b451
Spinnaker Integration:V2
yogesh-s-modak Nov 12, 2024
8e43cc5
Spinnaker Integration:V2
yogesh-s-modak Nov 12, 2024
97c6782
Spinnaker Integration:V2
yogesh-s-modak Nov 12, 2024
e00f21b
Spinnaker Integration:V2
yogesh-s-modak Nov 12, 2024
772e9b4
Spinnaker Integration:V2
yogesh-s-modak Nov 12, 2024
1c8d8df
Merge branch 'master' into spinnaker_integration
yogesh-s-modak Nov 12, 2024
1ec482d
Spinnaker Integration:V2
yogesh-s-modak Nov 12, 2024
bcc343f
Merge remote-tracking branch 'origin/spinnaker_integration' into spin…
yogesh-s-modak Nov 12, 2024
dbc5b02
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
a9c9dc5
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
ae72bb4
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
314da26
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
d242c4a
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
89bd852
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
1714989
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
c26f092
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
2f59e7b
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
670fd21
Merge branch 'master' into spinnaker_integration
yogesh-s-modak Nov 13, 2024
cfd205b
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
8a0a4cb
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
9633796
Spinnaker Integration:V3
yogesh-s-modak Nov 13, 2024
3cbd705
Merge branch 'master' into spinnaker_integration
yogesh-s-modak Nov 14, 2024
4076ebe
Spinnaker Integration:V3
yogesh-s-modak Nov 14, 2024
81ad215
Spinnaker Integration:V3
yogesh-s-modak Nov 14, 2024
bab0c28
Spinnaker Integration:V4
yogesh-s-modak Nov 15, 2024
5e3303d
Spinnaker Integration:V4
yogesh-s-modak Nov 15, 2024
6f2e589
Spinnaker Integration:V4
yogesh-s-modak Nov 15, 2024
39c2da5
Spinnaker Integration:V4
yogesh-s-modak Nov 15, 2024
0f0eb34
Spinnaker Integration:V4
yogesh-s-modak Nov 15, 2024
71de592
Spinnaker Integration:V4
yogesh-s-modak Nov 15, 2024
35db418
Spinnaker Integration:V4
yogesh-s-modak Nov 15, 2024
ce9ed5d
Merge branch 'master' into spinnaker_integration
yogesh-s-modak Nov 15, 2024
aa6b4a0
Spinnaker Integration:V5
yogesh-s-modak Nov 18, 2024
9b5397c
Merge branch 'spinnaker_integration' of https://github.com/yogesh-s-m…
yogesh-s-modak Nov 18, 2024
95f469a
Spinnaker Integration:V5
yogesh-s-modak Nov 18, 2024
89e31dc
Spinnaker Integration:V5
yogesh-s-modak Nov 18, 2024
aa5b344
Merge branch 'master' into spinnaker_integration
yogesh-s-modak Nov 18, 2024
95da0a9
Merge branch 'master' into spinnaker_integration
yogesh-s-modak Nov 19, 2024
7c13167
Merge branch 'master' of https://github.com/yogesh-s-modak/integratio…
yogesh-s-modak Nov 20, 2024
0d7a45f
Merge branch 'spinnaker_integration' of https://github.com/yogesh-s-m…
yogesh-s-modak Nov 20, 2024
3f1a151
Spinnaker Integration:V6
yogesh-s-modak Nov 20, 2024
151470f
Update spinnaker/CHANGELOG.md
yogesh-s-modak Nov 21, 2024
398b460
Update spinnaker/README.md
yogesh-s-modak Nov 21, 2024
2c4a813
Merge branch 'master' into spinnaker_integration
yogesh-s-modak Nov 21, 2024
091212f
Merge branch 'master' into spinnaker_integration
yogesh-s-modak Nov 25, 2024
e813ca3
Merge branch 'master' into spinnaker_integration
yogesh-s-modak Nov 26, 2024
1cd918d
Spinnaker Build Check
yogesh-s-modak Nov 26, 2024
d318b3e
Spinnaker Data Models Sync
yogesh-s-modak Nov 26, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions .codecov.yml

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where is the parser file?

Original file line number Diff line number Diff line change
Expand Up @@ -566,6 +566,10 @@ coverage:
target: 75
flags:
- spark
Spinnaker:
target: 75
flags:
- spinnaker
Squid:
target: 75
flags:
Expand Down Expand Up @@ -1439,6 +1443,11 @@ flags:
paths:
- spark/datadog_checks/spark
- spark/tests
spinnaker:
carryforward: true
paths:
- spinnaker/datadog_checks/spinnaker
- spinnaker/tests
sqlserver:
carryforward: true
paths:
Expand Down
3 changes: 3 additions & 0 deletions .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
Expand Up @@ -152,6 +152,9 @@ manifest.json @DataDog/documentation @DataDog/agent-integrations
/vsphere/ @DataDog/platform-integrations @DataDog/agent-integrations
/vsphere/manifest.json @DataDog/platform-integrations @DataDog/agent-integrations @DataDog/documentation
/vsphere/*.md @DataDog/platform-integrations @DataDog/agent-integrations @DataDog/documentation
/spinnaker/ @DataDog/platform-integrations @DataDog/agent-integrations
/spinnaker/manifest.json @DataDog/platform-integrations @DataDog/agent-integrations @DataDog/documentation
/spinnaker/*.md @DataDog/platform-integrations @DataDog/agent-integrations @DataDog/documentation

# System checks
/disk/ @DataDog/agent-integrations @DataDog/windows-agent
Expand Down
20 changes: 20 additions & 0 deletions .github/workflows/test-all.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3294,6 +3294,26 @@ jobs:
minimum-base-package: ${{ inputs.minimum-base-package }}
pytest-args: ${{ inputs.pytest-args }}
secrets: inherit
j6554f3a:
uses: ./.github/workflows/test-target.yml
with:
job-name: Spinnaker
target: spinnaker
platform: linux
runner: '["ubuntu-22.04"]'
repo: "${{ inputs.repo }}"
python-version: "${{ inputs.python-version }}"
standard: ${{ inputs.standard }}
latest: ${{ inputs.latest }}
agent-image: "${{ inputs.agent-image }}"
agent-image-py2: "${{ inputs.agent-image-py2 }}"
agent-image-windows: "${{ inputs.agent-image-windows }}"
agent-image-windows-py2: "${{ inputs.agent-image-windows-py2 }}"
test-py2: ${{ inputs.test-py2 }}
test-py3: ${{ inputs.test-py3 }}
minimum-base-package: ${{ inputs.minimum-base-package }}
pytest-args: ${{ inputs.pytest-args }}
secrets: inherit
j31a95c8:
uses: ./.github/workflows/test-target.yml
with:
Expand Down
9 changes: 9 additions & 0 deletions spinnaker/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# CHANGELOG - Spinnaker

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
<!-- towncrier release notes start -->

Could you add this to the md. We use towncrier to compile our changelogs. One of the validations will fail other wise.

<!-- towncrier release notes start -->

## 1.0.0 / 2024-11-12

***Added***:

* Initial Release
yogesh-s-modak marked this conversation as resolved.
Show resolved Hide resolved
108 changes: 108 additions & 0 deletions spinnaker/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,108 @@
# Agent Check: Spinnaker

## Overview

This check monitors [Spinnaker][1].

Spinnaker is an open-source, multi-cloud continuous delivery (CD) platform originally developed by Netflix. It’s designed to automate and streamline the software release process, enabling faster and more reliable deployments to the cloud.
yogesh-s-modak marked this conversation as resolved.
Show resolved Hide resolved

This integration integrates Spinnaker with Datadog, providing comprehensive monitoring and visibility across all Spinnaker components. It centralizes logs from Clouddriver, Orca, Redis, Rosco, Deck, and Echo, enabling teams to monitor, analyze, and troubleshoot deployment workflows and infrastructure operations efficiently
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
This integration integrates Spinnaker with Datadog, providing comprehensive monitoring and visibility across all Spinnaker components. It centralizes logs from Clouddriver, Orca, Redis, Rosco, Deck, and Echo, enabling teams to monitor, analyze, and troubleshoot deployment workflows and infrastructure operations efficiently
This integration integrates Spinnaker with Datadog, providing comprehensive monitoring and visibility across all Spinnaker components. It centralizes logs from Clouddriver, Orca, Redis, Rosco, Deck, and Echo, enabling teams to monitor, analyze, and troubleshoot deployment workflows and infrastructure operations efficiently.


### Benefits of Integration:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
### Benefits of Integration:
### Benefits of Integration


- **Centralized Monitoring**: Allows customers to view, analyze, and manage all Spinnaker logs in Datadog, improving operational visibility.
- **Enhanced Troubleshooting**: Faster root-cause analysis by centralizing logs for different Spinnaker components, helping resolve issues more quickly.
- **Performance Optimization**: Detailed metrics for pipelines, caching, image baking, etc., allow fine-tuning of workflows and infrastructure management.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **Performance Optimization**: Detailed metrics for pipelines, caching, image baking, etc., allow fine-tuning of workflows and infrastructure management.
- **Performance Optimization**: Detailed metrics for pipelines, caching, image baking, and so on, allowing fine-tuning of workflows and infrastructure management.


### Specific Data Monitored:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
### Specific Data Monitored:
### Specific Data Monitored


- **Infrastructure Changes**: Logs from Clouddriver, valuable for tracking resource management and API performance.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **Infrastructure Changes**: Logs from Clouddriver, valuable for tracking resource management and API performance.
- **Infrastructure changes**: Logs from Clouddriver, valuable for tracking resource management and API performance.

- **Pipeline Status and Errors**: Orca logs provide data on pipeline execution and errors, improving deployment reliability.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **Pipeline Status and Errors**: Orca logs provide data on pipeline execution and errors, improving deployment reliability.
- **Pipeline status and errors**: Orca logs provide data on pipeline execution and errors, improving deployment reliability.

- **Cache Performance**: Redis logs monitor caching, helping optimize data retrieval and storage efficiency.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **Cache Performance**: Redis logs monitor caching, helping optimize data retrieval and storage efficiency.
- **Cache performance**: Redis logs monitor caching, helping optimize data retrieval and storage efficiency.

- **Image Creation and Consistency**: Rosco logs ensure smooth image baking, which supports reliable deployment environments.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **Image Creation and Consistency**: Rosco logs ensure smooth image baking, which supports reliable deployment environments.
- **Image creation and consistency**: Rosco logs ensure smooth image baking, which supports reliable deployment environments.

- **User and Notification Activity**: Deck and Echo logs help track UI activity and notifications, ensuring smooth user experience and reliable alerting.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **User and Notification Activity**: Deck and Echo logs help track UI activity and notifications, ensuring smooth user experience and reliable alerting.
- **User and notification activity**: Deck and Echo logs help track UI activity and notifications, ensuring smooth user experience and reliable alerting.


## Setup

### Installation

**To install the Spinnaker check on your host:**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
**To install the Spinnaker check on your host:**
To install the Spinnaker check on your host:



1. Install the [developer toolkit]
(https://docs.datadoghq.com/developers/integrations/python/)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please use reference-style links. Thank you!

on any machine.

2. Run `ddev release build spinnaker` to build the package.

3. [Download the Datadog Agent][2].

4. Upload the build artifact to any host with an Agent and
run
`datadog-agent integration install -w
path/to/spinnaker/dist/<ARTIFACT_NAME>.whl`.

### Configuration

#### Prerequisites

Have your Datadog [API][10] key on hand.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Have your Datadog [API][10] key on hand.
You must have a Datadog [API][10] key.

Just to avoid idioms, which can be confusing for folks who speak English as an additional language.


#### Installation
To install the Datadog Agent on a host, use the one-line installation, updated with the Datadog API key from your account:

`DD_API_KEY=<DATADOG_API_KEY> DD_SITE="datadoghq.com" bash -c "$(curl -L https://install.datadoghq.com/scripts/install_script_agent7.sh)"`

- Start the agent using:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Start the agent using:
- Start the Agent:


`sudo systemctl start datadog-agent`

- Stop the agent using:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Stop the agent using:
- Stop the Agent:


`sudo systemctl stop datadog-agent`

- Restart the agent using:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Restart the agent using:
- Restart the Agent:


`sudo systemctl restart datadog-agent`


### Validation

Check if the agent is running using:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Check if the agent is running using:
Check if the Agent is running:

- `sudo systemctl status datadog-agent`

- `sudo datadog-agent status`

## Data Collected

### Logs

Spinnaker ingests logs from multiple sources.

### Metrics

Spinnaker does not include any metrics.

### Service Checks

Spinnaker does not include any service checks.

### Events

Spinnaker does not include any events.

## Troubleshooting

Need help? Contact [Datadog support][3].

[1]: **LINK_TO_INTEGRATION_SITE**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just flagging this to be updated

[2]: https://app.datadoghq.com/account/settings/agent/latest
[3]: https://docs.datadoghq.com/agent/kubernetes/integrations/
[4]: https://github.com/DataDog/integrations-extras/blob/master/spinnaker/datadog_checks/spinnaker/data/conf.yaml.example
[5]: https://docs.datadoghq.com/agent/guide/agent-commands/#start-stop-and-restart-the-agent
[6]: https://docs.datadoghq.com/agent/guide/agent-commands/#agent-status-and-information
[7]: https://github.com/DataDog/integrations-extras/blob/master/spinnaker/metadata.csv
[8]: https://github.com/DataDog/integrations-extras/blob/master/spinnaker/assets/service_checks.json
[9]: https://docs.datadoghq.com/help/
[10]: https://app.datadoghq.com/organization-settings/api-keys?_gl=1*ek9ow0*_gcl_au*MTgxNDQ0MjA4Ni4xNzI1NDQwNjkw*_ga*MTg1OTA0NDgzLjE3MjgyODMwOTQ.*_ga_KN80RDFSQK*MTczMDcxNjc0Ni45LjAuMTczMDcxNjc0Ni4wLjAuMjAyMDM0NjYxNQ..*_fplc*JTJCMGolMkY5OVYyJTJGMEUxaE1EUzUlMkJqcEExcUJJMTRiT2R6ZTg5clpqNmdraHJQJTJCbVFMaFAzcHVXS0ZSdE13OVZWMlA2RUllYTRCVW1od0d0JTJCRUhzUEJXaVFucDFja0NacWk4V1pvamJOejFVUUR2QVVKdlI1WVd2azNuSEY1YzR3JTNEJTNE

10 changes: 10 additions & 0 deletions spinnaker/assets/configuration/spec.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
name: Spinnaker
files:
- name: spinnaker.yaml
options:
- template: init_config
options:
- template: init_config/default
- template: instances
options:
- template: instances/default
Loading
Loading