Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] master from TykTechnologies:master #93

Merged
merged 102 commits into from
Sep 26, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
102 commits
Select commit Hold shift + click to select a range
b4db9b2
TT-3514 - Adding CosmosDB support (#481)
mativm02 Sep 9, 2022
fac0819
Bump version to v1.7 (#487)
kolavcic Sep 12, 2022
bc27ee0
Releng sync (#495)
ermirizio Oct 11, 2022
4c490cb
TT-6550 | Document size is mis-calculated in Mongo Selective Pump (#496)
mativm02 Oct 13, 2022
97bbecc
TT-6482 Histogram type label validation (#497)
sredxny Oct 18, 2022
ba8a4b5
[TT-6012] Implement New Graph Granular Mongo Pump (#489)
kofoworola Oct 18, 2022
155b05a
TT-6799 Prometheus pump: Support to disable certain metric families f…
hsyed-dojo Oct 18, 2022
ff7574e
[TT-6012] mongo graph records ignore max_document_size_bytes (#504)
kofoworola Oct 25, 2022
1976511
TT-6890 Prometheus custom metrics env vars (#505)
tbuchaillot Oct 26, 2022
d93d779
ignore the field ApiSchema in SQL (#506)
sredxny Oct 27, 2022
a4631e8
adding prometheus default env var postfix (#509)
tbuchaillot Nov 2, 2022
84f3855
TT-3067 - Add ability to use ssl_insecure_skip_verify with Elasticsea…
mativm02 Nov 2, 2022
d13b62e
[TT-506] - Self-Healing when hitting 16mb + making aggregation per ti…
mativm02 Nov 2, 2022
8e42170
[TT-6012] fix edge case where the query is to an unresolved subgraph …
kofoworola Nov 3, 2022
1f0bc24
[TT-5426] - Improve Tyk Pump demo mode (#513)
mativm02 Nov 9, 2022
de9ced0
[TT-2485] Support MongoDB Connection argument "readPreference" (#517)
mativm02 Nov 14, 2022
776b9fa
TT-6278 Mongo blur URL (#518)
tbuchaillot Nov 15, 2022
6cb1edc
TT-6834 Timeout documentation (#520)
tbuchaillot Nov 15, 2022
7b67cd3
Added table for tyk analytics record schema (#527)
LLe27 Nov 17, 2022
5a25a2e
[TT-5429] Tyk Pump Ignore Fields (#519)
mativm02 Nov 18, 2022
d5e9afb
updted version of TykTechnologies/gorm (#528)
sredxny Nov 18, 2022
ca44921
[TT-5426] Updating timestamp of every record in Demo Mode (#529)
mativm02 Nov 23, 2022
665b72a
changing from user's location to UTC by default (#534)
mativm02 Nov 24, 2022
5fd437e
Fix typo in timestream pump docs (#524)
tbuchaillot Nov 24, 2022
92be2bd
Update upgradefrom attribute (#532)
ermirizio Nov 24, 2022
906d54f
Fix Sync-Automation (#535)
ermirizio Nov 29, 2022
13cd67f
using proper semantic for pump version (#537)
tbuchaillot Dec 2, 2022
94bdb89
Enable automerge for sync automation PRs. (#536)
asutosh Dec 5, 2022
5f1ef16
TT-506/2 - Adding info about self-healing (#507)
mativm02 Dec 6, 2022
6392fe3
Releng sync: test automerge (#542)
asutosh Dec 6, 2022
c98c681
Bump actions/checkout from 2 to 3.1.0 (#494)
dependabot[bot] Dec 7, 2022
03f498f
Bump actions/cache from 2 to 3 (#521)
dependabot[bot] Dec 7, 2022
a00434b
[TD-1348]: Enabling automerge for sync automation PRs (#552)
asutosh Dec 15, 2022
06f324a
[TT-7345] Adding the possibility to create historical and future data…
mativm02 Dec 19, 2022
911f6af
Codeowners (#550)
ermirizio Dec 19, 2022
81be915
Deprecate set-output directive (#556)
ermirizio Dec 21, 2022
9caf2d7
Adding unit tests to CSV pump (#539)
mativm02 Dec 22, 2022
e2f277a
TT-7216 Decode Option For Raw Request/Response (#558)
Jan 12, 2023
ee07435
[TT-7482] feat: implement graph sql pump (#562)
kofoworola Jan 23, 2023
4363089
Increasing test coverage of logger package (#563)
mativm02 Jan 24, 2023
2a478d8
Remove logrus-prefixed-formatter (#567)
titpetric Feb 9, 2023
5e649db
Add gpac files (#565)
Tyk-ITS Feb 15, 2023
5ccf526
[TT-7820]Feat: sql aggregate pump (#566)
kofoworola Feb 20, 2023
4088d90
Add remote backend to tf cloud (#572)
Tyk-ITS Feb 20, 2023
17072c0
[TT-7977] fix: include RootFields in graph mongo and sql pumps (#571)
kofoworola Feb 21, 2023
5ec13c3
adding time to stdout pump (#574)
tbuchaillot Mar 2, 2023
7fa0754
[TT-7820] fix: Fix aggregate graph pump sharding and errors (#575)
kofoworola Mar 6, 2023
18b16f1
Add Resurface backend to pumps (#531)
monrax Mar 13, 2023
5933928
TT-7163 Fix prometheus import #584
tbuchaillot Mar 13, 2023
6766381
Update murmur3 to latest (#580)
titpetric Mar 14, 2023
3e521be
TT-8314 replace uuid lib + bump go version #582
tbuchaillot Mar 14, 2023
e1bb7c9
automated push by gromit (#587)
ermirizio Mar 15, 2023
416a6eb
Update environment variables for Prometheus (#564)
buraksekili Mar 15, 2023
ca22ae4
TT-8313 Hybrid pump refactor (#588)
tbuchaillot Mar 16, 2023
9cd44dd
TT-8314 Fix sec issues (#592)
tbuchaillot Mar 20, 2023
f2770d8
automated push by gromit (#594)
ermirizio Mar 28, 2023
8458e11
[TT-7952] Implementing storage library (#597)
mativm02 Apr 12, 2023
68b2206
changing initial log and pump's version (#605)
mativm02 Apr 19, 2023
51e48e1
updating storage to v1.0.1 (#607)
mativm02 Apr 20, 2023
04b6481
adding TT-7216 and TT-8229 to readme (#609)
mativm02 Apr 24, 2023
0cc6569
add the purge logging to resurface pump (#611)
sedkis Apr 25, 2023
b925e6f
[TT-8782] Skip raw_request_decoded and raw_response_decoded if Pump i…
mativm02 Apr 26, 2023
1fd5ba9
[TT-8793] Fixing Pump 1.8 bugs (#616)
mativm02 Apr 27, 2023
2622025
Changing conf 'driver_type' to 'driver' (#618)
mativm02 Apr 28, 2023
bab7af3
updating MongoDriverType comment (#622)
mativm02 May 4, 2023
6269449
Removing blank line from MongoDriverType comment (#624)
mativm02 May 4, 2023
b580100
updating MongoDriverType comment (#626)
mativm02 May 5, 2023
84331f1
[TD-1648]: Updating sync automation - tyk-pump:master (#620)
asutosh May 10, 2023
3bd84f7
[TD-1648]: Updating releng tyk-pump:master (#621)
asutosh May 10, 2023
3cecf3c
Update sync automation workflow (#631)
asutosh May 10, 2023
ccd57f9
TT-8905 changed the default mongo driver to mgo (#632)
sredxny May 10, 2023
7f27476
Adding Direct Connection (#634)
mativm02 May 11, 2023
8173c7e
TT-876 Fix/prometheus cardinality (#636)
tbuchaillot May 15, 2023
0ed84b9
fix: include grap records in mongo pump (#638)
kofoworola May 17, 2023
2b40aeb
Updating to storage v1.0.4 (#639)
mativm02 May 17, 2023
3785503
TT-8942 Change default RPC pool size (#642)
tbuchaillot May 19, 2023
93b8aee
Updating to storage v1.0.5 (#646)
mativm02 May 22, 2023
2d3c296
[TT-8884]: added write data test for mongo pump and remove constraint…
kofoworola May 25, 2023
54d0455
[TT-8999] Overriding pumps with the same name (#648)
mativm02 May 29, 2023
8ebd118
[TT-8999] - Converting pump name to lower case when looking for it (#…
mativm02 Jun 1, 2023
376711f
Update README.md (#655)
caroltyk Jun 12, 2023
6820131
[TT-9126] Fix error log when omit_configfile option is enabled (#654)
mativm02 Jun 12, 2023
0fc3713
[TT-8846] Updating to Go 1.19 (#652)
mativm02 Jun 15, 2023
6571f35
add (#665)
ermirizio Jun 15, 2023
254bc0a
Fixing TestToUpperPumps flaky test (#658)
mativm02 Jun 16, 2023
4b2b078
Updating struct comments (#666)
mativm02 Jun 16, 2023
332f7b6
Adding comment to 'meta' field (#668)
mativm02 Jun 19, 2023
ee66e7b
pin point goreleaser version (#677)
ermirizio Jul 4, 2023
c70cf3a
TT-9334 upgraded influx to v1.8.10 (#682)
sredxny Jul 18, 2023
af48e86
TT-9490 change name from APISchema to ApiSchema (#681)
sredxny Jul 21, 2023
1a6d80b
update regex to blur mongo credentials (#686)
sredxny Jul 26, 2023
9cfce6e
updated prometheus to 1.16 (#688)
sredxny Jul 26, 2023
1145397
Auto generated from templates by gromit (#692)
alephnull Jul 26, 2023
0117688
[TT-9464] Updating storage to v1.0.7 (#689)
mativm02 Jul 26, 2023
b538a89
Fix pump CI (#695)
tbuchaillot Jul 31, 2023
91dd8a0
[TT-9360] Changing Timeout from time.Duration to int (#696)
mativm02 Aug 1, 2023
a1fad74
[TT-9464] Updating storage to v1.0.8 (#698)
mativm02 Aug 8, 2023
3bf1f85
[TT-9855]: fix index creation error on graph sql pump creation (#715)
kofoworola Aug 23, 2023
69f5f4a
TT-9873 Fix prometheus tracking path (#716)
tbuchaillot Aug 23, 2023
657436f
[TT-9468] New SQL Aggregate indexes (#694)
tbuchaillot Aug 29, 2023
092d669
updating TrackAllPaths comment (#722)
mativm02 Sep 8, 2023
7af2a45
[TT-100053]: aggregate graph aggregate records by api_id (#725)
kofoworola Sep 18, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
/ci/ @TykTechnologies/devops
.github/workflows/release.yml @TykTechnologies/devops
.github/workflows/sync-automation.yml @TykTechnologies/devops
.github/workflows/pac.yml @TykTechnologies/devops
/repo-policy/ @TykTechnologies/devops
4 changes: 3 additions & 1 deletion .github/dependabot.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@

# Generated by: gromit policy
# Generated on: Mon Aug 8 03:03:25 UTC 2022
# Generated on: Wed Jul 26 08:25:03 UTC 2023

version: 2
updates:
Expand All @@ -9,6 +9,8 @@ updates:
directory: "/"
schedule:
interval: "weekly"
reviewers:
- "TykTechnologies/devops"

- package-ecosystem: "gomod"
# Look for `go.mod` file in the `root` directory
Expand Down
17 changes: 8 additions & 9 deletions .github/workflows/ci-test.yml
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
name: CI tests

on:
on:
pull_request:
push:
branches:
branches:
- master

env:
Expand All @@ -21,11 +21,11 @@ jobs:
matrix:
redis-version: [5]
mongodb-version: [4.2]
go: [1.16]
go: [1.19]

steps:
- name: Checkout Tyk Pump
uses: actions/checkout@v2
uses: actions/checkout@v3
with:
fetch-depth: 2

Expand All @@ -38,7 +38,7 @@ jobs:
id: hygiene
run: |
go install golang.org/x/tools/cmd/goimports@latest

- name: Fetch base branch
if: ${{ github.event_name == 'pull_request' }}
run: git fetch origin ${{ github.base_ref }}
Expand All @@ -51,10 +51,10 @@ jobs:
- name: Start MongoDB
uses: supercharge/[email protected]
with:
mongodb-version: '${{ matrix.mongodb-version }}'
mongodb-version: "${{ matrix.mongodb-version }}"

- name: Cache
uses: actions/cache@v2
uses: actions/cache@v3
with:
path: ~/go/pkg/mod
key: ${{ runner.os }}-go-${{ hashFiles('**/go.sum') }}
Expand All @@ -66,7 +66,7 @@ jobs:
run: |
./bin/ci-test.sh 2>&1 | tee test.log
result_code=${PIPESTATUS[0]}
echo "::set-output name=log::$(sed -ze 's/%/%25/g;s/\n/%0A/g' test.log)"
echo "log=$(sed -ze 's/%/%25/g;s/\n/%0A/g' test.log)" >> $GITHUB_OUTPUT
exit $result_code

- name: Download golangci-lint
Expand All @@ -81,4 +81,3 @@ jobs:
if: ${{ github.event_name == 'push' }}
run: |
$(go env GOPATH)/bin/golangci-lint run --out-format checkstyle --timeout=300s --max-issues-per-linter=0 --max-same-issues=0 --issues-exit-code=0 ./... > golanglint.xml

2 changes: 1 addition & 1 deletion .github/workflows/codeql-analysis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ jobs:

steps:
- name: Checkout repository
uses: actions/checkout@v2
uses: actions/checkout@v3
with:
# We must fetch at least the immediate parents so that if this is
# a pull request then we can checkout the head.
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/del-env.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@

# Generated by: gromit policy
# Generated on: Mon Aug 8 03:03:25 UTC 2022
# Generated on: Wed May 10 06:24:08 UTC 2023

name: Retiring dev env

Expand Down
6 changes: 4 additions & 2 deletions .github/workflows/linter.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ on:
- main
pull_request:
workflow_dispatch:

env:
TYK_PMP_ANALYTICSSTORAGETYPE: redis
TYK_PMP_ANALYTICSSTORAGECONFIG_TYPE: redis
Expand All @@ -22,17 +22,19 @@ jobs:
strategy:
fail-fast: false
matrix:
go: [1.16, 1.17]
go: [1.19]
with:
go: ${{ matrix.go }}
redis: 5
mongo: 4.2
test-options: ""-count=1 -failfast -v""
golangci:
needs: gotest
if: ${{ always() }}
uses: TykTechnologies/github-actions/.github/workflows/golangci.yaml@main
with:
main_branch: "master"
go_version: 1.19
sonarcloud:
if: ${{ always() }}
needs: [gotest, golangci]
Expand Down
85 changes: 85 additions & 0 deletions .github/workflows/pac.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
name: Policy as Code

on:
pull_request:
paths:
- repo-policy/**

env:
TERRAFORM_DIR: "./repo-policy"

jobs:
terraform:
runs-on: ubuntu-latest
permissions:
id-token: write
pull-requests: write

steps:
- name: Checkout
uses: actions/checkout@v3
with:
fetch-depth: 1

- uses: aws-actions/configure-aws-credentials@v1
with:
role-to-assume: arn:aws:iam::754489498669:role/gromit-ci
role-session-name: gromitci
aws-region: eu-central-1

- uses: hashicorp/setup-terraform@v2
with:
terraform_version: 1.3.0
cli_config_credentials_token: ${{ secrets.TF_API_TOKEN }}

- name: Terraform Init
working-directory: ${{ env.TERRAFORM_DIR }}
id: init
run: terraform init -input=false

- name: Terraform Validate
id: validate
run: terraform validate -no-color

- name: Terraform Plan
working-directory: ${{ env.TERRAFORM_DIR }}
id: plan
run: |
echo "::group::Terraform Plan"
terraform plan -no-color -input=false
echo "::endgroup::"
continue-on-error: true

- name: Update Pull Request
uses: actions/github-script@v6
if: github.event_name == 'pull_request'
env:
PLAN: "terraform\n${{ steps.plan.outputs.stdout }}"
with:
github-token: ${{ secrets.GITHUB_TOKEN }}
script: |
const output = `#### Terraform Format and Style 🖌\`${{ steps.fmt.outcome }}\`
#### Terraform Initialization ⚙️\`${{ steps.init.outcome }}\`
#### Terraform Plan 📖\`${{ steps.plan.outcome }}\`
#### Terraform Validation 🤖\`${{ steps.validate.outcome }}\`

<details><summary>Show Plan</summary>

\`\`\`\n
${process.env.PLAN}
\`\`\`

</details>

*Pushed by: @${{ github.actor }}, Action: \`${{ github.event_name }}\`*`;

github.rest.issues.createComment({
issue_number: context.issue.number,
owner: context.repo.owner,
repo: context.repo.repo,
body: output
})

- name: Terraform Plan Status
if: steps.plan.outcome == 'failure'
run: exit 1
Loading
Loading