From a4d3ed374e9fa8f8d40a6400d0d554421c956963 Mon Sep 17 00:00:00 2001 From: Julien Perrochet Date: Tue, 19 Mar 2024 00:00:35 +0100 Subject: [PATCH] [uss_qualifier] check off DSS0215 and DSS020 for subscriptions (partial) (#533) * dss-0215 check off DSS0215 and DSS020 for subscriptions * Without markdown list --- .../astm/utm/dss/fragments/sub/sync.md | 81 ++++++++++++++++--- .../suites/astm/utm/dss_probing.md | 12 ++- .../uss_qualifier/suites/astm/utm/f3548_21.md | 12 ++- .../suites/faa/uft/message_signing.md | 12 ++- .../suites/interuss/dss/all_tests.md | 12 ++- .../suites/uspace/flight_auth.md | 12 ++- .../suites/uspace/required_services.md | 12 ++- 7 files changed, 137 insertions(+), 16 deletions(-) diff --git a/monitoring/uss_qualifier/scenarios/astm/utm/dss/fragments/sub/sync.md b/monitoring/uss_qualifier/scenarios/astm/utm/dss/fragments/sub/sync.md index fe52647a8e..8d3e921d09 100644 --- a/monitoring/uss_qualifier/scenarios/astm/utm/dss/fragments/sub/sync.md +++ b/monitoring/uss_qualifier/scenarios/astm/utm/dss/fragments/sub/sync.md @@ -5,49 +5,110 @@ This test step fragment validates that subscriptions are properly synchronized a ## 🛑 Subscription can be found at every DSS check If the previously created or mutated subscription cannot be found at a DSS, either one of the instances at which the subscription was created or the one that was queried, -may be failing to implement **[astm.f3548.v21.DSS0210,1a](../../../../../../requirements/astm/f3548/v21.md)**. +is failing to implement one of the following requirements: + +**[astm.f3548.v21.DSS0210,1a](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. ## 🛑 Propagated subscription contains the correct USS base URL check If the subscription returned by a DSS to which the subscription was synchronized to does not contain the correct USS base URL, -either one of the instances at which the subscription was created or the one that was queried, may be failing to implement **[astm.f3548.v21.DSS0210,1c](../../../../../../requirements/astm/f3548/v21.md)**. +either one of the instances at which the subscription was created or the one that was queried, +is failing to implement one of the following requirements: + +**[astm.f3548.v21.DSS0210,1c](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. ## 🛑 Propagated subscription contains the correct start time check If the subscription returned by a DSS to which the subscription was synchronized to does not contain the correct start time, -either one of the instances at which the subscription was created or the one that was queried, may be failing to implement **[astm.f3548.v21.DSS0210,1e](../../../../../../requirements/astm/f3548/v21.md)**. +either one of the instances at which the subscription was created or the one that was queried, +is failing to implement one of the following requirements: + +**[astm.f3548.v21.DSS0210,1e](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. ## 🛑 Propagated subscription contains the correct end time check If the subscription returned by a DSS to which the subscription was synchronized to does not contain the correct end time, -either one of the instances at which the subscription was created or the one that was queried, may be failing to implement **[astm.f3548.v21.DSS0210,1e](../../../../../../requirements/astm/f3548/v21.md)**. +either one of the instances at which the subscription was created or the one that was queried, +is failing to implement one of the following requirements: + +**[astm.f3548.v21.DSS0210,1e](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. ## 🛑 Propagated subscription contains the correct version check If the subscription returned by a DSS to which the subscription was synchronized to does not contain the correct version, -either one of the instances at which the subscription was created or the one that was queried, may be failing to implement **[astm.f3548.v21.DSS0210,1f](../../../../../../requirements/astm/f3548/v21.md)**. +either one of the instances at which the subscription was created or the one that was queried, +is failing to implement one of the following requirements: + +**[astm.f3548.v21.DSS0210,1f](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. ## 🛑 Propagated subscription contains the correct notification flags check If the subscription returned by a DSS to which the subscription was synchronized to does not contain the correct notification flags, -either one of the instances at which the subscription was created or the one that was queried, may be failing to implement **[astm.f3548.v21.DSS0210,1g](../../../../../../requirements/astm/f3548/v21.md)**. +either one of the instances at which the subscription was created or the one that was queried, +is failing to implement one of the following requirements: + +**[astm.f3548.v21.DSS0210,1g](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. ## 🛑 Propagated subscription contains the correct implicit flag check If the subscription returned by a DSS to which the subscription was synchronized to does not contain the correct implicit flag, -either one of the instances at which the subscription was created or the one that was queried, may be failing to implement **[astm.f3548.v21.DSS0210,1h](../../../../../../requirements/astm/f3548/v21.md)**. +either one of the instances at which the subscription was created or the one that was queried, +is failing to implement one of the following requirements: + +**[astm.f3548.v21.DSS0210,1h](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. ## 🛑 Propagated subscription contains expected notification count check If the subscription returned by a DSS to which the subscription was synchronized to does not contain the expected notification count, -either one of the instances at which the subscription was created or the one that was queried, may be failing to implement **[astm.f3548.v21.DSS0210,1i](../../../../../../requirements/astm/f3548/v21.md)**. +either one of the instances at which the subscription was created or the one that was queried, +is failing to implement one of the following requirements: + +**[astm.f3548.v21.DSS0210,1i](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. ## 🛑 Secondary DSS returns the subscription in searches for area that contains it check The secondary DSS should be aware of the subscription's area: when a search query is issued for an area that encompasses the created subscription, -the secondary DSS should return the subscription in its search results. Otherwise, it is in violation of **[astm.f3548.v21.DSS0210,1d](../../../../../../requirements/astm/f3548/v21.md)**. +the secondary DSS should return the subscription in its search results. + +Otherwise, it is in violation of one of the following requirements: + +**[astm.f3548.v21.DSS0210,1d](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. ## 🛑 Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription check The secondary DSS should be aware of the subscription's area: when a search query is issued for an area not in the vicinity of the created subscription, -the secondary DSS should not return it in its search results. Otherwise, it is in violation of **[astm.f3548.v21.DSS0210,1d](../../../../../../requirements/astm/f3548/v21.md)**. +the secondary DSS should not return it in its search results. + +Otherwise, it is in violation of one of the following requirements: + +**[astm.f3548.v21.DSS0210,1d](../../../../../../requirements/astm/f3548/v21.md)**, if the API is not working as described by the OpenAPI specification; +**[astm.f3548.v21.DSS0215](../../../../../../requirements/astm/f3548/v21.md)**, if the DSS is returning API calls to the client before having updated its underlying distributed storage. + +As a result, the DSS pool under test is failing to meet **[astm.f3548.v21.DSS0020](../../../../../../requirements/astm/f3548/v21.md)**. diff --git a/monitoring/uss_qualifier/suites/astm/utm/dss_probing.md b/monitoring/uss_qualifier/suites/astm/utm/dss_probing.md index c9d4e631c4..bb254e1415 100644 --- a/monitoring/uss_qualifier/suites/astm/utm/dss_probing.md +++ b/monitoring/uss_qualifier/suites/astm/utm/dss_probing.md @@ -21,7 +21,7 @@ Checked in - astm
.f3548
.v21 + astm
.f3548
.v21 DSS0005,1 Implemented ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
ASTM SCD DSS: Subscription Simple
ASTM SCD DSS: Subscription Synchronization
ASTM SCD DSS: Subscription Validation @@ -41,6 +41,11 @@ Implemented ASTM SCD DSS: Subscription Validation + + DSS0020 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0200 Implemented @@ -91,6 +96,11 @@ Implemented ASTM SCD DSS: Subscription Synchronization + + DSS0215 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0300 Implemented diff --git a/monitoring/uss_qualifier/suites/astm/utm/f3548_21.md b/monitoring/uss_qualifier/suites/astm/utm/f3548_21.md index fb9a9fec82..fd553b4644 100644 --- a/monitoring/uss_qualifier/suites/astm/utm/f3548_21.md +++ b/monitoring/uss_qualifier/suites/astm/utm/f3548_21.md @@ -35,7 +35,7 @@ Checked in - astm
.f3548
.v21 + astm
.f3548
.v21 DSS0005,1 Implemented ASTM F3548 flight planners preparation
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
ASTM SCD DSS: Subscription Simple
ASTM SCD DSS: Subscription Synchronization
ASTM SCD DSS: Subscription Validation
Off-Nominal planning: down USS
Off-Nominal planning: down USS with equal priority conflicts not permitted @@ -55,6 +55,11 @@ Implemented ASTM SCD DSS: Subscription Validation + + DSS0020 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0100,1 Implemented @@ -110,6 +115,11 @@ Implemented ASTM SCD DSS: Subscription Synchronization + + DSS0215 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0300 Implemented diff --git a/monitoring/uss_qualifier/suites/faa/uft/message_signing.md b/monitoring/uss_qualifier/suites/faa/uft/message_signing.md index b3e69423ea..978831cb78 100644 --- a/monitoring/uss_qualifier/suites/faa/uft/message_signing.md +++ b/monitoring/uss_qualifier/suites/faa/uft/message_signing.md @@ -18,7 +18,7 @@ Checked in - astm
.f3548
.v21 + astm
.f3548
.v21 DSS0005,1 Implemented ASTM F3548 flight planners preparation
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
ASTM SCD DSS: Subscription Simple
ASTM SCD DSS: Subscription Synchronization
ASTM SCD DSS: Subscription Validation
Off-Nominal planning: down USS
Off-Nominal planning: down USS with equal priority conflicts not permitted @@ -38,6 +38,11 @@ Implemented ASTM SCD DSS: Subscription Validation + + DSS0020 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0100,1 Implemented @@ -93,6 +98,11 @@ Implemented ASTM SCD DSS: Subscription Synchronization + + DSS0215 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0300 Implemented diff --git a/monitoring/uss_qualifier/suites/interuss/dss/all_tests.md b/monitoring/uss_qualifier/suites/interuss/dss/all_tests.md index 053a6748f6..809315c369 100644 --- a/monitoring/uss_qualifier/suites/interuss/dss/all_tests.md +++ b/monitoring/uss_qualifier/suites/interuss/dss/all_tests.md @@ -408,7 +408,7 @@ ASTM NetRID DSS: Concurrent Requests
ASTM NetRID DSS: ISA Expiry
ASTM NetRID DSS: ISA Subscription Interactions
ASTM NetRID DSS: Simple ISA
ASTM NetRID DSS: Submitted ISA Validations
ASTM NetRID DSS: Subscription Simple
ASTM NetRID DSS: Subscription Validation
ASTM NetRID DSS: Token Validation - astm
.f3548
.v21 + astm
.f3548
.v21 DSS0005,1 Implemented ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
ASTM SCD DSS: Subscription Simple
ASTM SCD DSS: Subscription Synchronization
ASTM SCD DSS: Subscription Validation @@ -428,6 +428,11 @@ Implemented ASTM SCD DSS: Subscription Validation + + DSS0020 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0200 Implemented @@ -478,6 +483,11 @@ Implemented ASTM SCD DSS: Subscription Synchronization + + DSS0215 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0300 Implemented diff --git a/monitoring/uss_qualifier/suites/uspace/flight_auth.md b/monitoring/uss_qualifier/suites/uspace/flight_auth.md index f6500b179e..63d9ad2c13 100644 --- a/monitoring/uss_qualifier/suites/uspace/flight_auth.md +++ b/monitoring/uss_qualifier/suites/uspace/flight_auth.md @@ -19,7 +19,7 @@ Checked in - astm
.f3548
.v21 + astm
.f3548
.v21 DSS0005,1 Implemented ASTM F3548 flight planners preparation
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
ASTM SCD DSS: Subscription Simple
ASTM SCD DSS: Subscription Synchronization
ASTM SCD DSS: Subscription Validation
Off-Nominal planning: down USS
Off-Nominal planning: down USS with equal priority conflicts not permitted @@ -39,6 +39,11 @@ Implemented ASTM SCD DSS: Subscription Validation + + DSS0020 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0100,1 Implemented @@ -94,6 +99,11 @@ Implemented ASTM SCD DSS: Subscription Synchronization + + DSS0215 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0300 Implemented diff --git a/monitoring/uss_qualifier/suites/uspace/required_services.md b/monitoring/uss_qualifier/suites/uspace/required_services.md index 2878452b5c..484d64e016 100644 --- a/monitoring/uss_qualifier/suites/uspace/required_services.md +++ b/monitoring/uss_qualifier/suites/uspace/required_services.md @@ -454,7 +454,7 @@ ASTM NetRID DSS: Concurrent Requests
ASTM NetRID DSS: ISA Expiry
ASTM NetRID DSS: ISA Subscription Interactions
ASTM NetRID DSS: Simple ISA
ASTM NetRID DSS: Submitted ISA Validations
ASTM NetRID DSS: Subscription Simple
ASTM NetRID DSS: Subscription Validation
ASTM NetRID DSS: Token Validation - astm
.f3548
.v21 + astm
.f3548
.v21 DSS0005,1 Implemented ASTM F3548 flight planners preparation
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
ASTM SCD DSS: Subscription Simple
ASTM SCD DSS: Subscription Synchronization
ASTM SCD DSS: Subscription Validation
Off-Nominal planning: down USS
Off-Nominal planning: down USS with equal priority conflicts not permitted @@ -474,6 +474,11 @@ Implemented ASTM SCD DSS: Subscription Validation + + DSS0020 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0100,1 Implemented @@ -529,6 +534,11 @@ Implemented ASTM SCD DSS: Subscription Synchronization + + DSS0215 + Implemented + ASTM SCD DSS: Subscription Synchronization + DSS0300 Implemented