From b708802b005dc892ebcfa56952e6a26af17e68c8 Mon Sep 17 00:00:00 2001 From: "github-actions[bot]" Date: Tue, 7 Nov 2023 17:01:04 +0000 Subject: [PATCH] [uss_qualifier] Separate artifact-making from main.py (#321) * Separate artifact-making from main.py * Fix shell lint * Add multiple-config documentation per comments 197381398d21bc12b7ff83a214ebd548b1048a8c --- .../reports/dss_probing/report.json | 2 +- .../dss_probing/requirements/status.json | 8 +- .../dss_probing/requirements/uss1.html | 1666 +++++++------- .../dss_probing/requirements/uss2.html | 1666 +++++++------- .../reports/dss_probing/sequence/index.html | 14 +- .../reports/dss_probing/sequence/s1.html | 378 ++-- .../reports/dss_probing/sequence/s2.html | 144 +- .../reports/dss_probing/sequence/s3.html | 82 +- .../reports/dss_probing/sequence/s4.html | 158 +- .../reports/dss_probing/sequence/s5.html | 652 +++--- .../reports/dss_probing/sequence/s6.html | 334 +-- .../reports/dss_probing/sequence/s7.html | 38 +- .../uss_qualifier/reports/f3548/report.json | 2 +- .../reports/f3548/requirements/status.json | 8 +- .../reports/f3548/requirements/uss1.html | 736 +++--- .../reports/f3548/requirements/uss2.html | 736 +++--- .../reports/f3548/sequence/index.html | 18 +- .../reports/f3548/sequence/s1.html | 334 +-- .../reports/f3548/sequence/s10.html | 1310 +++++------ .../reports/f3548/sequence/s11.html | 10 +- .../reports/f3548/sequence/s2.html | 334 +-- .../reports/f3548/sequence/s3.html | 1402 ++++++------ .../reports/f3548/sequence/s4.html | 1442 ++++++------ .../reports/f3548/sequence/s5.html | 1388 ++++++------ .../reports/f3548/sequence/s6.html | 1414 ++++++------ .../reports/f3548/sequence/s7.html | 1224 +++++----- .../reports/f3548/sequence/s8.html | 1224 +++++----- .../reports/f3548/sequence/s9.html | 1418 ++++++------ .../reports/general_flight_auth/report.json | 2 +- .../requirements/status.json | 8 +- .../requirements/uss1.html | 40 +- .../general_flight_auth/sequence/index.html | 74 +- .../general_flight_auth/sequence/s1.html | 70 +- ...test_data.che.netrid.circular_flights.json | 12 +- .../reports/geoawareness_cis/report.json | 2 +- .../geospatial_comprehension/report.json | 2 +- .../reports/message_signing/report.json | 2 +- .../reports/netrid_v19/report.json | 2 +- .../netrid_v19/requirements/status.json | 8 +- .../reports/netrid_v19/requirements/uss1.html | 1114 ++++----- .../reports/netrid_v19/requirements/uss2.html | 1010 ++++----- .../reports/netrid_v19/sequence/index.html | 30 +- .../reports/netrid_v19/sequence/s1.html | 394 ++-- .../reports/netrid_v19/sequence/s2.html | 144 +- .../reports/netrid_v19/sequence/s3.html | 82 +- .../reports/netrid_v19/sequence/s4.html | 168 +- .../reports/netrid_v19/sequence/s5.html | 660 +++--- .../reports/netrid_v19/sequence/s6.html | 334 +-- .../reports/netrid_v19/sequence/s7.html | 38 +- .../reports/netrid_v22a/report.json | 2 +- .../netrid_v22a/requirements/status.json | 8 +- .../netrid_v22a/requirements/uss1.html | 1146 +++++----- .../netrid_v22a/requirements/uss2.html | 1010 ++++----- .../reports/netrid_v22a/sequence/index.html | 32 +- .../reports/netrid_v22a/sequence/s1.html | 378 ++-- .../reports/netrid_v22a/sequence/s2.html | 144 +- .../reports/netrid_v22a/sequence/s3.html | 82 +- .../reports/netrid_v22a/sequence/s4.html | 158 +- .../reports/netrid_v22a/sequence/s5.html | 656 +++--- .../reports/netrid_v22a/sequence/s6.html | 322 +-- .../reports/netrid_v22a/sequence/s7.html | 38 +- .../uss_qualifier/reports/noop/report.html | 36 +- .../uss_qualifier/reports/noop/report.json | 36 +- .../reports/noop/sequence/index.html | 14 +- .../reports/noop/sequence/s1.html | 10 +- .../reports/uspace/capabilities.html | 2 +- .../uss_qualifier/reports/uspace/report.json | 2 +- .../reports/uspace/requirements/status.json | 8 +- .../reports/uspace/requirements/uss1.html | 2004 ++++++++--------- .../reports/uspace/requirements/uss2.html | 2004 ++++++++--------- .../reports/uspace/sequence/index.html | 34 +- .../reports/uspace/sequence/s1.html | 56 +- .../reports/uspace/sequence/s10.html | 1436 ++++++------ .../reports/uspace/sequence/s11.html | 1224 +++++----- .../reports/uspace/sequence/s12.html | 1424 ++++++------ .../reports/uspace/sequence/s13.html | 1390 ++++++------ .../reports/uspace/sequence/s14.html | 1244 +++++----- .../reports/uspace/sequence/s15.html | 10 +- .../reports/uspace/sequence/s16.html | 82 +- .../reports/uspace/sequence/s17.html | 88 +- .../reports/uspace/sequence/s18.html | 378 ++-- .../reports/uspace/sequence/s19.html | 144 +- .../reports/uspace/sequence/s2.html | 42 +- .../reports/uspace/sequence/s20.html | 82 +- .../reports/uspace/sequence/s21.html | 158 +- .../reports/uspace/sequence/s22.html | 656 +++--- .../reports/uspace/sequence/s23.html | 322 +-- .../reports/uspace/sequence/s24.html | 38 +- .../reports/uspace/sequence/s3.html | 6 +- .../reports/uspace/sequence/s4.html | 6 +- .../reports/uspace/sequence/s5.html | 334 +-- .../reports/uspace/sequence/s6.html | 342 +-- .../reports/uspace/sequence/s7.html | 1388 ++++++------ .../reports/uspace/sequence/s8.html | 1512 ++++++------- .../reports/uspace/sequence/s9.html | 1452 ++++++------ 95 files changed, 22139 insertions(+), 22139 deletions(-) diff --git a/artifacts/uss_qualifier/reports/dss_probing/report.json b/artifacts/uss_qualifier/reports/dss_probing/report.json index b604fe3fa1..02651b2a34 100644 --- a/artifacts/uss_qualifier/reports/dss_probing/report.json +++ b/artifacts/uss_qualifier/reports/dss_probing/report.json @@ -1 +1 @@ -{"codebase_version": "interuss/monitoring/v0.0.0-079c92b", "commit_hash": "079c92b67fb65366b165c1512c319174facf3aca", "baseline_signature": "21813fb08140f0d2883d6350a8c3f29e32a72b68cecc49e9078a2eaa93e211bd", "environment_signature": "383670842b90e623e04660bab8132198849a61457e0d90caf9eebb0df6322efb", "configuration": {"resources": {"resource_declarations": {"id_generator": {"resource_type": "resources.interuss.IDGeneratorResource", "dependencies": {"auth_adapter": "utm_auth"}, "specification": {"whoami_audience": "localhost", "whoami_scope": "rid.display_provider"}}, "kentland_service_area": {"resource_type": "resources.netrid.ServiceAreaResource", "specification": {"base_url": "https://uss_qualifier.test.utm/dummy_base_url", "footprint": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}], "altitude_min": 0.0, "altitude_max": 3048.0, "reference_time": "2023-01-10T00:00:00.123456+00:00", "time_start": "2023-01-10T00:00:01.123456+00:00", "time_end": "2023-01-10T01:00:01.123456+00:00"}, "dependencies": {}}, "kentland_problematically_big_area": {"resource_type": "resources.VerticesResource", "specification": {"vertices": [{"lat": 38.0, "lng": -81.0}, {"lat": 37.0, "lng": -81.0}, {"lat": 37.0, "lng": -80.0}, {"lat": 38.0, "lng": -80.0}]}, "dependencies": {}}, "utm_auth": {"resource_type": "resources.communications.AuthAdapterResource", "specification": {"environment_variable_containing_auth_spec": "AUTH_SPEC"}, "dependencies": {}}, "scd_dss_instances": {"resource_type": "resources.astm.f3548.v21.DSSInstancesResource", "dependencies": {"auth_adapter": "utm_auth"}, "specification": {"dss_instances": [{"participant_id": "uss1", "base_url": "http://dss.uss1.localutm", "has_private_address": true}, {"participant_id": "uss2", "base_url": "http://dss.uss2.localutm", "has_private_address": true}]}}, "netrid_dss_instances_v22a": {"resource_type": "resources.astm.f3411.DSSInstancesResource", "dependencies": {"auth_adapter": "utm_auth"}, "specification": {"dss_instances": [{"participant_id": "uss1", "rid_version": "F3411-22a", "base_url": "http://dss.uss1.localutm/rid/v2", "has_private_address": true, "local_debug": true}, {"participant_id": "uss2", "rid_version": "F3411-22a", "base_url": "http://dss.uss2.localutm/rid/v2", "has_private_address": true, "local_debug": true}]}}, "netrid_dss_instances_v19": {"resource_type": "resources.astm.f3411.DSSInstancesResource", "dependencies": {"auth_adapter": "utm_auth"}, "specification": {"dss_instances": [{"participant_id": "uss1", "rid_version": "F3411-19", "base_url": "http://dss.uss1.localutm", "has_private_address": true, "local_debug": true}, {"participant_id": "uss2", "rid_version": "F3411-19", "base_url": "http://dss.uss2.localutm", "has_private_address": true, "local_debug": true}]}}}}, "non_baseline_inputs": ["v1.test_run.resources.resource_declarations.utm_auth", "v1.test_run.resources.resource_declarations.scd_dss_instances", "v1.test_run.resources.resource_declarations.netrid_dss_instances_v22a", "v1.test_run.resources.resource_declarations.netrid_dss_instances_v19"], "action": {"test_suite": {"suite_type": "suites.interuss.dss.all_tests", "resources": {"f3411v19_dss_instances": "netrid_dss_instances_v19", "f3411v22a_dss_instances": "netrid_dss_instances_v22a", "id_generator": "id_generator", "service_area": "kentland_service_area", "problematically_big_area": "kentland_problematically_big_area"}}, "on_failure": "Continue"}, "execution": {"stop_fast": true, "include_action_when": null, "skip_action_when": null}}, "report": {"test_suite": {"name": "ASTM DSS tests", "suite_type": "suites.interuss.dss.all_tests", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/suites/interuss/dss/all_tests.md", "start_time": "2023-11-07T15:06:41.438396Z", "actions": [{"action_generator": {"actions": [{"test_suite": {"name": "DSS testing for ASTM NetRID F3411-19", "suite_type": "suites.astm.netrid.f3411_19.dss_probing", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/suites/astm/netrid/f3411_19/dss_probing.md", "start_time": "2023-11-07T15:06:41.438719Z", "actions": [{"test_scenario": {"name": "ASTM NetRID DSS: Simple ISA", "scenario_type": "scenarios.astm.netrid.v19.dss.ISASimple", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md", "start_time": "2023-11-07T15:06:41.438910Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#setup-test-case", "start_time": "2023-11-07T15:06:41.438981Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T15:06:41.439033Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:41.445847Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.439091Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "106"}, "elapsed_s": 0.003161, "reported": "2023-11-07T15:06:41.445095Z", "json": {"message": "ISA 0000015c-e36d-40be-d38b-eca6ca350000 not found (E:73ce9943-1eb0-4b1d-9a5b-417c271e2625)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.445943Z"}], "end_time": "2023-11-07T15:06:41.445977Z"}, {"name": "Create and check ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#create-and-check-isa-test-case", "start_time": "2023-11-07T15:06:41.446027Z", "steps": [{"name": "Create ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/put_isa.md#create-or-update-isa-test-step", "start_time": "2023-11-07T15:06:41.446073Z", "failed_checks": [], "passed_checks": [{"name": "ISA response code", "timestamp": "2023-11-07T15:06:41.459690Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA response format", "timestamp": "2023-11-07T15:06:41.647426Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA ID matches", "timestamp": "2023-11-07T15:06:41.647548Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA version format", "timestamp": "2023-11-07T15:06:41.647600Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA start time matches", "timestamp": "2023-11-07T15:06:41.647650Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA end time matches", "timestamp": "2023-11-07T15:06:41.647695Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA URL matches", "timestamp": "2023-11-07T15:06:41.647745Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA created", "timestamp": "2023-11-07T15:06:41.648188Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.447153Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:41.908731Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "8106a977-e84e-4903-b029-cd003c1216e6"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "291"}, "elapsed_s": 0.007009, "reported": "2023-11-07T15:06:41.456402Z", "json": {"subscribers": [], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:41.908731Z", "version": "1f5avkoe8dpjo", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.648218Z"}, {"name": "Get ISA by ID", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#get-isa-by-id-test-step", "start_time": "2023-11-07T15:06:41.648247Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:41.652384Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA", "interuss.f3411.dss_endpoints.GetISA"]}, {"name": "ISA version match", "timestamp": "2023-11-07T15:06:41.652995Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.648299Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "274"}, "elapsed_s": 0.001894, "reported": "2023-11-07T15:06:41.650876Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:41.908731Z", "version": "1f5avkoe8dpjo", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.653024Z"}], "end_time": "2023-11-07T15:06:41.653041Z"}, {"name": "Update and search ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#update-and-search-isa-test-case", "start_time": "2023-11-07T15:06:41.653076Z", "steps": [{"name": "Update ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/put_isa.md#create-or-update-isa-test-step", "start_time": "2023-11-07T15:06:41.653113Z", "failed_checks": [], "passed_checks": [{"name": "ISA response code", "timestamp": "2023-11-07T15:06:41.663077Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA response format", "timestamp": "2023-11-07T15:06:41.673738Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA ID matches", "timestamp": "2023-11-07T15:06:41.673810Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA version changed", "timestamp": "2023-11-07T15:06:41.673858Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA version format", "timestamp": "2023-11-07T15:06:41.673902Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA start time matches", "timestamp": "2023-11-07T15:06:41.673948Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA end time matches", "timestamp": "2023-11-07T15:06:41.673989Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA URL matches", "timestamp": "2023-11-07T15:06:41.674036Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA updated", "timestamp": "2023-11-07T15:06:41.674405Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000/1f5avkoe8dpjo", "initiated_at": "2023-11-07T15:06:41.653762Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:42.908731Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "db62018e-0d6b-4736-bb01-f0c6e89282b4"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "291"}, "elapsed_s": 0.005856, "reported": "2023-11-07T15:06:41.660272Z", "json": {"subscribers": [], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:42.908731Z", "version": "1f5avkokbspoo", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.674434Z"}, {"name": "Get ISA by ID", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#get-isa-by-id-test-step-1", "start_time": "2023-11-07T15:06:41.674469Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:41.678308Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA", "interuss.f3411.dss_endpoints.GetISA"]}, {"name": "ISA version match", "timestamp": "2023-11-07T15:06:41.678917Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.674515Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "274"}, "elapsed_s": 0.001708, "reported": "2023-11-07T15:06:41.676843Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:42.908731Z", "version": "1f5avkokbspoo", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.678945Z"}, {"name": "Search by earliest time (included)", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T15:06:41.678976Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T15:06:41.693048Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T15:06:41.693098Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA returned by search", "timestamp": "2023-11-07T15:06:41.693828Z", "participants": ["uss1"], "requirements": []}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544&earliest_time=2023-11-07T16:05:42.908731Z", "initiated_at": "2023-11-07T15:06:41.679078Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "277"}, "elapsed_s": 0.002425, "reported": "2023-11-07T15:06:41.682061Z", "json": {"service_areas": [{"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:42.908731Z", "version": "1f5avkokbspoo", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}]}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.693859Z"}, {"name": "Search by earliest time (excluded)", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T15:06:41.693893Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T15:06:41.706867Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T15:06:41.706922Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA not returned by search", "timestamp": "2023-11-07T15:06:41.707118Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544&earliest_time=2023-11-07T16:07:42.908731Z", "initiated_at": "2023-11-07T15:06:41.693980Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "21"}, "elapsed_s": 0.002115, "reported": "2023-11-07T15:06:41.696722Z", "json": {"service_areas": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.707150Z"}, {"name": "Search by latest time (included)", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T15:06:41.707184Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T15:06:41.721254Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T15:06:41.721309Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA returned by search", "timestamp": "2023-11-07T15:06:41.722068Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544&latest_time=2023-11-07T15:07:41.908731Z", "initiated_at": "2023-11-07T15:06:41.707273Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "277"}, "elapsed_s": 0.0022, "reported": "2023-11-07T15:06:41.710112Z", "json": {"service_areas": [{"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:42.908731Z", "version": "1f5avkokbspoo", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}]}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.722099Z"}, {"name": "Search by latest time (excluded)", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T15:06:41.722135Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T15:06:41.735089Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T15:06:41.735137Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA not returned by search", "timestamp": "2023-11-07T15:06:41.735300Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544&latest_time=2023-11-07T15:05:41.908731Z", "initiated_at": "2023-11-07T15:06:41.722226Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "21"}, "elapsed_s": 0.002413, "reported": "2023-11-07T15:06:41.725318Z", "json": {"service_areas": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.735330Z"}, {"name": "Search by area only", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T15:06:41.735365Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T15:06:41.748644Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T15:06:41.748685Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA returned by search", "timestamp": "2023-11-07T15:06:41.749369Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:41.735436Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "277"}, "elapsed_s": 0.00204, "reported": "2023-11-07T15:06:41.738091Z", "json": {"service_areas": [{"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:42.908731Z", "version": "1f5avkokbspoo", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}]}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.749400Z"}, {"name": "Search with invalid params", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#search-with-invalid-params-test-step", "start_time": "2023-11-07T15:06:41.749433Z", "failed_checks": [], "passed_checks": [{"name": "Search request rejected", "timestamp": "2023-11-07T15:06:41.751210Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=", "initiated_at": "2023-11-07T15:06:41.749481Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "68"}, "elapsed_s": 0.000929, "reported": "2023-11-07T15:06:41.750978Z", "json": {"message": "Missing area (E:87009d0f-451c-4bd9-b98f-5ff28ab567b0)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.751263Z"}, {"name": "Search by huge area", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#search-by-huge-area-test-step", "start_time": "2023-11-07T15:06:41.751317Z", "failed_checks": [], "passed_checks": [{"name": "Search request rejected", "timestamp": "2023-11-07T15:06:41.753010Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=38.0,-81.0,37.0,-81.0,37.0,-80.0,38.0,-80.0", "initiated_at": "2023-11-07T15:06:41.751416Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 413, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "70"}, "elapsed_s": 0.000871, "reported": "2023-11-07T15:06:41.752791Z", "json": {"message": "Area too large (E:3017f99d-aebb-47df-8447-a8fe29ef9aae)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.753066Z"}, {"name": "Search ISA with loop", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#search-isa-with-loop-test-step", "start_time": "2023-11-07T15:06:41.753121Z", "failed_checks": [], "passed_checks": [{"name": "Search request rejected", "timestamp": "2023-11-07T15:06:41.754992Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544,37.1853,-80.614", "initiated_at": "2023-11-07T15:06:41.753225Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "103"}, "elapsed_s": 0.000813, "reported": "2023-11-07T15:06:41.754750Z", "json": {"message": "Intersection found between polygon edge 1 and 4 (E:775f235e-3f1f-48d1-a69e-662fedc0a97a)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.755068Z"}], "end_time": "2023-11-07T15:06:41.755120Z"}, {"name": "Delete ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#delete-isa-test-case", "start_time": "2023-11-07T15:06:41.755175Z", "steps": [{"name": "Delete with wrong version", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#delete-with-wrong-version-test-step", "start_time": "2023-11-07T15:06:41.755216Z", "failed_checks": [], "passed_checks": [{"name": "Delete request rejected", "timestamp": "2023-11-07T15:06:41.757995Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000/f5avkokbspo", "initiated_at": "2023-11-07T15:06:41.755266Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": null, "body": null}, "response": {"code": 409, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "127"}, "elapsed_s": 0.001962, "reported": "2023-11-07T15:06:41.757756Z", "json": {"message": "ISA currently at version 1f5avkokbspoo but client specified f5avkokbspo (E:3f06d98b-e2a0-401b-a4fe-76792458aa0e)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.758048Z"}, {"name": "Delete with empty version", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#delete-with-empty-version-test-step", "start_time": "2023-11-07T15:06:41.758097Z", "failed_checks": [], "passed_checks": [{"name": "Delete request rejected", "timestamp": "2023-11-07T15:06:41.759901Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000/", "initiated_at": "2023-11-07T15:06:41.758170Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": null, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "78"}, "elapsed_s": 0.000826, "reported": "2023-11-07T15:06:41.759660Z", "json": {"message": "Missing version string (E:96a3ed01-c520-4379-952d-d9d321583b28)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.759957Z"}, {"name": "Delete ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/delete_isa.md#delete-isa-test-step", "start_time": "2023-11-07T15:06:41.760004Z", "failed_checks": [], "passed_checks": [{"name": "ISA response format", "timestamp": "2023-11-07T15:06:41.779117Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}, {"name": "ISA ID matches", "timestamp": "2023-11-07T15:06:41.779191Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}, {"name": "ISA version matches", "timestamp": "2023-11-07T15:06:41.779237Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}, {"name": "ISA deleted", "timestamp": "2023-11-07T15:06:41.779263Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000/1f5avkokbspoo", "initiated_at": "2023-11-07T15:06:41.760103Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "291"}, "elapsed_s": 0.005131, "reported": "2023-11-07T15:06:41.765999Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.908731Z", "time_end": "2023-11-07T16:06:42.908731Z", "version": "1f5avkokbspoo", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}, "subscribers": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.779284Z"}, {"name": "Get deleted ISA by ID", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#get-deleted-isa-by-id-test-step", "start_time": "2023-11-07T15:06:41.779311Z", "failed_checks": [], "passed_checks": [{"name": "ISA not found", "timestamp": "2023-11-07T15:06:41.781726Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.779355Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "106"}, "elapsed_s": 0.001503, "reported": "2023-11-07T15:06:41.781450Z", "json": {"message": "ISA 0000015c-e36d-40be-d38b-eca6ca350000 not found (E:ba4d2f01-f7b6-4010-b221-d5dafbaa8c30)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.781780Z"}, {"name": "Search ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T15:06:41.781829Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T15:06:41.793796Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T15:06:41.793848Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA not returned by search", "timestamp": "2023-11-07T15:06:41.794023Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:41.781942Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "21"}, "elapsed_s": 0.001661, "reported": "2023-11-07T15:06:41.784166Z", "json": {"service_areas": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.794053Z"}], "end_time": "2023-11-07T15:06:41.794071Z"}], "successful": true, "end_time": "2023-11-07T15:06:41.794089Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#cleanup", "start_time": "2023-11-07T15:06:41.794117Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:41.796655Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.794148Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "106"}, "elapsed_s": 0.001609, "reported": "2023-11-07T15:06:41.796356Z", "json": {"message": "ISA 0000015c-e36d-40be-d38b-eca6ca350000 not found (E:aa263cb3-72fc-4d8d-9217-72aa115159e8)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.796727Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: Submitted ISA Validations", "scenario_type": "scenarios.astm.netrid.v19.dss.ISAValidation", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md", "start_time": "2023-11-07T15:06:41.797243Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#setup-test-case", "start_time": "2023-11-07T15:06:41.797318Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T15:06:41.797379Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:41.799497Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.797432Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "106"}, "elapsed_s": 0.001236, "reported": "2023-11-07T15:06:41.799240Z", "json": {"message": "ISA 00000170-e36d-40be-d38b-eca6ca350000 not found (E:3265d391-1293-4d4a-93dd-4cd040bbc0cc)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.799573Z"}], "end_time": "2023-11-07T15:06:41.799602Z"}, {"name": "ISA Validation", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#isa-validation-test-case", "start_time": "2023-11-07T15:06:41.799637Z", "steps": [{"name": "ISA Validation", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#isa-validation-test-step", "start_time": "2023-11-07T15:06:41.799674Z", "failed_checks": [], "passed_checks": [{"name": "ISA huge area", "timestamp": "2023-11-07T15:06:41.802089Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA empty vertices", "timestamp": "2023-11-07T15:06:41.804540Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA start time in the past", "timestamp": "2023-11-07T15:06:41.807451Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA start time after end time", "timestamp": "2023-11-07T15:06:41.810498Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA vertices are valid", "timestamp": "2023-11-07T15:06:41.813350Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA missing outline", "timestamp": "2023-11-07T15:06:41.815257Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA missing volume", "timestamp": "2023-11-07T15:06:41.816937Z", "participants": ["uss1"], "requirements": []}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.800368Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "442", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 38.0, "lng": -81.0}, {"lat": 37.0, "lng": -81.0}, {"lat": 37.0, "lng": -80.0}, {"lat": 38.0, "lng": -80.0}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.925103Z", "time_end": "2023-11-07T16:06:41.925103Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "a87c0939-8ed9-4222-9130-a72772e0fbaa"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "70"}, "elapsed_s": 0.000908, "reported": "2023-11-07T15:06:41.801815Z", "json": {"message": "Area too large (E:4bf2afee-b19c-4c43-a8f1-3ab97f706a26)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.802840Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "328", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": []}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.925103Z", "time_end": "2023-11-07T16:06:41.925103Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "58950135-be3c-443e-911b-890f377cde9b"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "93"}, "elapsed_s": 0.000821, "reported": "2023-11-07T15:06:41.804218Z", "json": {"message": "Missing or malformed required extents (E:89fa4c1f-ca93-45ea-8579-0b9aa3931396)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.805546Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T14:56:41.804598Z", "time_end": "2023-11-07T15:56:41.804598Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "cb10050a-fab0-4905-acb2-64b1bd676bb9"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "116"}, "elapsed_s": 0.001033, "reported": "2023-11-07T15:06:41.807162Z", "json": {"message": "IdentificationServiceArea time_start must not be in the past (E:27af62f8-ba08-46ee-b751-228f20df61e2)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.808328Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-01-10T01:00:01.123456Z", "time_end": "2023-01-10T00:00:01.123456Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "7417575a-b72c-44e9-9cd4-6db9154b1569"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "116"}, "elapsed_s": 0.001168, "reported": "2023-11-07T15:06:41.810120Z", "json": {"message": "IdentificationServiceArea time_start must not be in the past (E:4ee66f37-f2ca-4471-ae7d-5706727915be)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.811342Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "474", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 130.0, "lng": -23.0}, {"lat": 130.0, "lng": -24.000000000000004}, {"lat": 132.0, "lng": -24.000000000000004}, {"lat": 132.0, "lng": -23.0}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-01-10T00:00:01.123456Z", "time_end": "2023-01-10T01:00:01.123456Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "5191e089-917f-48d5-b59b-1b645deb9c1f"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "101"}, "elapsed_s": 0.001053, "reported": "2023-11-07T15:06:41.813082Z", "json": {"message": "Coordinates did not create a well-formed area (E:07173201-2d7d-4fc5-8ba9-b473bea6dc99)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.813503Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "297", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.925103Z", "time_end": "2023-11-07T16:06:41.925103Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "a87c0939-8ed9-4222-9130-a72772e0fbaa"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "93"}, "elapsed_s": 0.000835, "reported": "2023-11-07T15:06:41.815047Z", "json": {"message": "Missing or malformed required extents (E:bd4f891c-50a9-4232-9ba8-feaab32b24f8)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.815380Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "234", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"time_start": "2023-11-07T15:06:41.925103Z", "time_end": "2023-11-07T16:06:41.925103Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "a87c0939-8ed9-4222-9130-a72772e0fbaa"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "93"}, "elapsed_s": 0.000809, "reported": "2023-11-07T15:06:41.816724Z", "json": {"message": "Missing or malformed required extents (E:8217d1b4-d475-49b4-9c71-a50736407a1c)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.816976Z"}], "end_time": "2023-11-07T15:06:41.817000Z"}], "successful": true, "end_time": "2023-11-07T15:06:41.817028Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#cleanup", "start_time": "2023-11-07T15:06:41.817072Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:41.819480Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.817123Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "106"}, "elapsed_s": 0.001431, "reported": "2023-11-07T15:06:41.819226Z", "json": {"message": "ISA 00000170-e36d-40be-d38b-eca6ca350000 not found (E:08c00ee0-29be-4d2c-9284-35b7d12ab02e)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.819555Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: ISA Expiry", "scenario_type": "scenarios.astm.netrid.v19.dss.ISAExpiry", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md", "start_time": "2023-11-07T15:06:41.819980Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#setup-test-case", "start_time": "2023-11-07T15:06:41.820042Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T15:06:41.820087Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:41.822170Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.820151Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "106"}, "elapsed_s": 0.001127, "reported": "2023-11-07T15:06:41.821920Z", "json": {"message": "ISA 00000171-e36d-40be-d38b-eca6ca350000 not found (E:510e7eb4-82a0-4218-9bb7-8292996a8679)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:41.822263Z"}], "end_time": "2023-11-07T15:06:41.822296Z"}, {"name": "ISA Expiry", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#isa-expiry-test-case", "start_time": "2023-11-07T15:06:41.822331Z", "steps": [{"name": "ISA Expiry", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#isa-expiry-test-step", "start_time": "2023-11-07T15:06:41.822369Z", "failed_checks": [], "passed_checks": [{"name": "Create short-lived ISA", "timestamp": "2023-11-07T15:06:41.830698Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Expired ISAs are not part of search results", "timestamp": "2023-11-07T15:06:46.834942Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "An expired ISA can be queried by its ID", "timestamp": "2023-11-07T15:06:46.838465Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:41.823004Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.822396Z", "time_end": "2023-11-07T15:06:46.822396Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "4b50ca7c-8855-4c05-bc36-a37ce6136a95"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:41 GMT", "Content-Length": "291"}, "elapsed_s": 0.00508, "reported": "2023-11-07T15:06:41.828708Z", "json": {"subscribers": [], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.822396Z", "time_end": "2023-11-07T15:06:46.822396Z", "version": "1f5avkopd4h38", "id": "00000171-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:46.831022Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:46 GMT", "Content-Length": "21"}, "elapsed_s": 0.002565, "reported": "2023-11-07T15:06:46.834397Z", "json": {"service_areas": []}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:46.835032Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:46 GMT", "Content-Length": "274"}, "elapsed_s": 0.001324, "reported": "2023-11-07T15:06:46.837043Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.822396Z", "time_end": "2023-11-07T15:06:46.822396Z", "version": "1f5avkopd4h38", "id": "00000171-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:46.838499Z"}], "end_time": "2023-11-07T15:06:46.838517Z"}], "successful": true, "end_time": "2023-11-07T15:06:46.838533Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#cleanup", "start_time": "2023-11-07T15:06:46.838559Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:46.841036Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}, {"name": "Removed pre-existing ISA", "timestamp": "2023-11-07T15:06:46.849749Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:46.838590Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:46 GMT", "Content-Length": "274"}, "elapsed_s": 0.001216, "reported": "2023-11-07T15:06:46.840304Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.822396Z", "time_end": "2023-11-07T15:06:46.822396Z", "version": "1f5avkopd4h38", "id": "00000171-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000/1f5avkopd4h38", "initiated_at": "2023-11-07T15:06:46.842063Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:46 GMT", "Content-Length": "291"}, "elapsed_s": 0.004828, "reported": "2023-11-07T15:06:46.847456Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.822396Z", "time_end": "2023-11-07T15:06:46.822396Z", "version": "1f5avkopd4h38", "id": "00000171-e36d-40be-d38b-eca6ca350000"}, "subscribers": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:46.849807Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: ISA Subscription Interactions", "scenario_type": "scenarios.astm.netrid.v19.dss.ISASubscriptionInteractions", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md", "start_time": "2023-11-07T15:06:46.850230Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#setup-test-case", "start_time": "2023-11-07T15:06:46.850306Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T15:06:46.850365Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:46.852796Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}, {"name": "Successful subscription search query", "timestamp": "2023-11-07T15:06:46.856625Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:46.850424Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:46 GMT", "Content-Length": "106"}, "elapsed_s": 0.00138, "reported": "2023-11-07T15:06:46.852474Z", "json": {"message": "ISA 00000172-e36d-40be-d38b-eca6ca350000 not found (E:09cc0059-9903-41ab-a72a-28afb82e0925)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:46.852954Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:46 GMT", "Content-Length": "21"}, "elapsed_s": 0.002451, "reported": "2023-11-07T15:06:46.856055Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:46.856779Z"}], "end_time": "2023-11-07T15:06:46.856802Z"}, {"name": "ISA Subscription Interactions", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#isa-subscription-interactions-test-case", "start_time": "2023-11-07T15:06:46.856830Z", "steps": [{"name": "ISA Subscription Interactions", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#isa-subscription-interactions-test-step", "start_time": "2023-11-07T15:06:46.856856Z", "failed_checks": [], "passed_checks": [{"name": "Create an ISA", "timestamp": "2023-11-07T15:06:46.864436Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Create a subscription within the ISA footprint", "timestamp": "2023-11-07T15:06:46.874484Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Subscription for the ISA's area mentions the ISA", "timestamp": "2023-11-07T15:06:46.875466Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Newly created subscription has a notification_index of 0", "timestamp": "2023-11-07T15:06:46.876850Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Mutate the ISA", "timestamp": "2023-11-07T15:06:47.010640Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Response to the mutation of the ISA contains subscription ID", "timestamp": "2023-11-07T15:06:47.013435Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Subscription to an ISA has its notification index incremented after mutation", "timestamp": "2023-11-07T15:06:47.014684Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Delete the ISA", "timestamp": "2023-11-07T15:06:47.138723Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Response to the deletion of the ISA contains subscription ID", "timestamp": "2023-11-07T15:06:47.141545Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}, {"name": "Subscription to an ISA has its notification index incremented after deletion", "timestamp": "2023-11-07T15:06:47.142814Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Successful subscription deletion", "timestamp": "2023-11-07T15:06:47.151936Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:46.857487Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.965568Z", "time_end": "2023-11-07T16:06:41.965568Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "546271b3-8fa7-4064-ba61-93c96e246357"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:46 GMT", "Content-Length": "291"}, "elapsed_s": 0.004528, "reported": "2023-11-07T15:06:46.862652Z", "json": {"subscribers": [], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.965568Z", "time_end": "2023-11-07T16:06:41.965568Z", "version": "1f5avktfedsh8", "id": "00000172-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000172-e36d-40be-d38b-eca6ca350001", "initiated_at": "2023-11-07T15:06:46.865282Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.965568Z", "time_end": "2023-11-07T16:06:41.965568Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "d9db2990-b77a-4516-837c-a3cb51a263f1"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:46 GMT", "Content-Length": "627"}, "elapsed_s": 0.007121, "reported": "2023-11-07T15:06:46.873040Z", "json": {"service_areas": [{"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.965568Z", "time_end": "2023-11-07T16:06:41.965568Z", "version": "1f5avktfedsh8", "id": "00000172-e36d-40be-d38b-eca6ca350000"}], "subscription": {"id": "00000172-e36d-40be-d38b-eca6ca350001", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T16:06:41.965568Z", "time_start": "2023-11-07T15:06:41.965568Z", "version": "1f5avktflqio8"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000/1f5avktfedsh8", "initiated_at": "2023-11-07T15:06:46.878088Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3047.0}, "time_start": "2023-11-07T15:06:41.965568Z", "time_end": "2023-11-07T16:06:41.965568Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "f62a3919-aa4f-4077-96e1-8e6d0f1acbd4"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:46 GMT", "Content-Length": "482"}, "elapsed_s": 0.005151, "reported": "2023-11-07T15:06:46.884091Z", "json": {"subscribers": [{"subscriptions": [{"subscription_id": "00000172-e36d-40be-d38b-eca6ca350001", "notification_index": 1}], "url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.965568Z", "time_end": "2023-11-07T16:06:41.965568Z", "version": "1f5avktg2nkh0", "id": "00000172-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000/1f5avktg2nkh0", "initiated_at": "2023-11-07T15:06:47.015460Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "482"}, "elapsed_s": 0.005869, "reported": "2023-11-07T15:06:47.021971Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T15:06:41.965568Z", "time_end": "2023-11-07T16:06:41.965568Z", "version": "1f5avktg2nkh0", "id": "00000172-e36d-40be-d38b-eca6ca350000"}, "subscribers": [{"subscriptions": [{"subscription_id": "00000172-e36d-40be-d38b-eca6ca350001", "notification_index": 2}], "url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}]}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000172-e36d-40be-d38b-eca6ca350001/1f5avktflqio8", "initiated_at": "2023-11-07T15:06:47.144018Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.005755, "reported": "2023-11-07T15:06:47.150425Z", "json": {"subscription": {"id": "00000172-e36d-40be-d38b-eca6ca350001", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 2, "time_end": "2023-11-07T16:06:41.965568Z", "time_start": "2023-11-07T15:06:41.965568Z", "version": "1f5avktflqio8"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.151979Z"}], "end_time": "2023-11-07T15:06:47.151997Z"}], "successful": true, "end_time": "2023-11-07T15:06:47.152014Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#cleanup", "start_time": "2023-11-07T15:06:47.152040Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T15:06:47.154162Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}, {"name": "Successful subscription search query", "timestamp": "2023-11-07T15:06:47.157182Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:47.152072Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "106"}, "elapsed_s": 0.001304, "reported": "2023-11-07T15:06:47.153902Z", "json": {"message": "ISA 00000172-e36d-40be-d38b-eca6ca350000 not found (E:3579e018-cd30-44d2-8041-21986d5a85c7)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:47.154310Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "21"}, "elapsed_s": 0.001718, "reported": "2023-11-07T15:06:47.156779Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.157403Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: Subscription Validation", "scenario_type": "scenarios.astm.netrid.v19.dss.SubscriptionValidation", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md", "start_time": "2023-11-07T15:06:47.157848Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#setup-test-case", "start_time": "2023-11-07T15:06:47.157914Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T15:06:47.157958Z", "failed_checks": [], "passed_checks": [{"name": "Successful subscription search query", "timestamp": "2023-11-07T15:06:47.160280Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:47.158043Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "21"}, "elapsed_s": 0.001327, "reported": "2023-11-07T15:06:47.159962Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.160448Z"}], "end_time": "2023-11-07T15:06:47.160472Z"}, {"name": "Subscription duration limitations", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#subscription-duration-limitations-test-case", "start_time": "2023-11-07T15:06:47.160497Z", "steps": [{"name": "Try to create too-long subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#try-to-create-too-long-subscription-test-step", "start_time": "2023-11-07T15:06:47.160527Z", "failed_checks": [], "passed_checks": [{"name": "Too-long subscription creation rejected", "timestamp": "2023-11-07T15:06:47.162943Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:47.161146Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.160565Z", "time_end": "2023-11-08T15:16:47.160565Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "5714989c-13b7-49f5-bcb6-58639baa7632"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "92"}, "elapsed_s": 0.000946, "reported": "2023-11-07T15:06:47.162659Z", "json": {"message": "Subscription window exceeds 24 hours (E:0b0aacb3-1927-4190-8789-7cf922e6c1c9)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.162994Z"}, {"name": "Try to extend subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#try-to-extend-subscription-test-step", "start_time": "2023-11-07T15:06:47.163037Z", "failed_checks": [], "passed_checks": [{"name": "Valid subscription created", "timestamp": "2023-11-07T15:06:47.171523Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Subscription duration limited during update", "timestamp": "2023-11-07T15:06:47.173930Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:47.163854Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.163102Z", "time_end": "2023-11-08T15:05:47.163102Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "0cf69612-ab6c-412f-be98-8cc41dc4f743"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006289, "reported": "2023-11-07T15:06:47.170686Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350000", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-08T15:05:47.163102Z", "time_start": "2023-11-07T15:06:47.163102Z", "version": "1f5avktoielno"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:47.172146Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.171587Z", "time_end": "2023-11-08T15:16:47.171587Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "c2d13e7f-fc12-48a1-a155-84bec9f4228f"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "92"}, "elapsed_s": 0.000934, "reported": "2023-11-07T15:06:47.173649Z", "json": {"message": "Subscription window exceeds 24 hours (E:df3dd3d3-ddd7-4069-9a7c-607514513a24)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.173979Z"}, {"name": "Remove subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#remove-subscription-test-step", "start_time": "2023-11-07T15:06:47.174023Z", "failed_checks": [], "passed_checks": [{"name": "Subscription deleted", "timestamp": "2023-11-07T15:06:47.181147Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350000/1f5avktoielno", "initiated_at": "2023-11-07T15:06:47.174994Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.00402, "reported": "2023-11-07T15:06:47.179623Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350000", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-08T15:05:47.163102Z", "time_start": "2023-11-07T15:06:47.163102Z", "version": "1f5avktoielno"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.181179Z"}], "end_time": "2023-11-07T15:06:47.181197Z"}, {"name": "Subscription quantity limitations", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#subscription-quantity-limitations-test-case", "start_time": "2023-11-07T15:06:47.181226Z", "steps": [{"name": "Create maximum number of subscriptions", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#create-maximum-number-of-subscriptions-test-step", "start_time": "2023-11-07T15:06:47.181254Z", "failed_checks": [], "passed_checks": [{"name": "Create up to the maximum allowed number of subscriptions in an area", "timestamp": "2023-11-07T15:06:47.274917Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350100", "initiated_at": "2023-11-07T15:06:47.181899Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.181299Z", "time_end": "2023-11-07T15:36:47.181299Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "baccadca-b40a-4e8e-a397-5e5b7b644ea2"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.013016, "reported": "2023-11-07T15:06:47.195584Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350100", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.181299Z", "time_start": "2023-11-07T15:06:47.181299Z", "version": "1f5avktp3qpkg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350101", "initiated_at": "2023-11-07T15:06:47.197099Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.196504Z", "time_end": "2023-11-07T15:36:47.196504Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "3825f35c-85ed-469e-9935-8b2810d2c164"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006171, "reported": "2023-11-07T15:06:47.203972Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350101", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.196504Z", "time_start": "2023-11-07T15:06:47.196504Z", "version": "1f5avktpiech0"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350102", "initiated_at": "2023-11-07T15:06:47.205467Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.204855Z", "time_end": "2023-11-07T15:36:47.204855Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "95772c6b-0316-43eb-9c65-77867cdd01b8"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006824, "reported": "2023-11-07T15:06:47.212976Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350102", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.204855Z", "time_start": "2023-11-07T15:06:47.204855Z", "version": "1f5avktpqc1n0"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350103", "initiated_at": "2023-11-07T15:06:47.214529Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.213917Z", "time_end": "2023-11-07T15:36:47.213917Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "3eef7114-102b-40bf-8d12-92f7a5f4f3f9"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006468, "reported": "2023-11-07T15:06:47.221743Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350103", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.213917Z", "time_start": "2023-11-07T15:06:47.213917Z", "version": "1f5avktq30m88"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350104", "initiated_at": "2023-11-07T15:06:47.223181Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.222603Z", "time_end": "2023-11-07T15:36:47.222603Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "61d9a0df-11cc-4002-80eb-85045154288e"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006366, "reported": "2023-11-07T15:06:47.230213Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350104", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.222603Z", "time_start": "2023-11-07T15:06:47.222603Z", "version": "1f5avktqb71og"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350105", "initiated_at": "2023-11-07T15:06:47.231863Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.231231Z", "time_end": "2023-11-07T15:36:47.231231Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "1563fb7f-012b-4d5d-8e69-bfe3ec4d04ec"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006572, "reported": "2023-11-07T15:06:47.239127Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350105", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.231231Z", "time_start": "2023-11-07T15:06:47.231231Z", "version": "1f5avktqjjbmg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350106", "initiated_at": "2023-11-07T15:06:47.240719Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.240092Z", "time_end": "2023-11-07T15:36:47.240092Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "b71e2cfd-5462-4208-b95e-04415896b8bb"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.00622, "reported": "2023-11-07T15:06:47.247601Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350106", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.240092Z", "time_start": "2023-11-07T15:06:47.240092Z", "version": "1f5avktqs0g08"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350107", "initiated_at": "2023-11-07T15:06:47.249158Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.248529Z", "time_end": "2023-11-07T15:36:47.248529Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "d0397663-9a12-4f12-ab9c-2de939bb2057"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006533, "reported": "2023-11-07T15:06:47.256413Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350107", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.248529Z", "time_start": "2023-11-07T15:06:47.248529Z", "version": "1f5avktr41fkg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350108", "initiated_at": "2023-11-07T15:06:47.258118Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.257414Z", "time_end": "2023-11-07T15:36:47.257414Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "c55271bc-a2c0-4465-804d-286e01db98a5"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006456, "reported": "2023-11-07T15:06:47.265277Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350108", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.257414Z", "time_start": "2023-11-07T15:06:47.257414Z", "version": "1f5avktrcku30"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350109", "initiated_at": "2023-11-07T15:06:47.266753Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.266165Z", "time_end": "2023-11-07T15:36:47.266165Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "db24e82d-7f0a-44bf-a6da-dff66e2d0a74"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006601, "reported": "2023-11-07T15:06:47.274064Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350109", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.266165Z", "time_start": "2023-11-07T15:06:47.266165Z", "version": "1f5avktrksdng"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.274953Z"}, {"name": "Exceed maximum number of subscriptions", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#exceed-maximum-number-of-subscriptions-test-step", "start_time": "2023-11-07T15:06:47.274982Z", "failed_checks": [], "passed_checks": [{"name": "Enforce maximum number of subscriptions for an area", "timestamp": "2023-11-07T15:06:47.279598Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0050"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350200", "initiated_at": "2023-11-07T15:06:47.275603Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:47.275031Z", "time_end": "2023-11-07T15:36:47.275031Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "5480a389-0bf8-492a-b1c1-ba43fbee955c"}, "body": null}, "response": {"code": 429, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "108"}, "elapsed_s": 0.003085, "reported": "2023-11-07T15:06:47.279317Z", "json": {"message": "Too many existing subscriptions in this area already (E:bcaf1fd3-5a44-40e1-bc67-b587fe7db25a)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.279643Z"}, {"name": "Clean up subscriptions", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#clean-up-subscriptions-test-step", "start_time": "2023-11-07T15:06:47.279687Z", "failed_checks": [], "passed_checks": [{"name": "Successful subscription search query", "timestamp": "2023-11-07T15:06:47.287216Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.298801Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.304194Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.309579Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.315105Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.320276Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.325643Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.332807Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.338196Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.344287Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.350177Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:47.279811Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Transfer-Encoding": "chunked"}, "elapsed_s": 0.002117, "reported": "2023-11-07T15:06:47.282701Z", "json": {"subscriptions": [{"id": "0000016f-e36d-40be-d38b-eca6ca350100", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.181299Z", "time_start": "2023-11-07T15:06:47.181299Z", "version": "1f5avktp3qpkg"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350101", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.196504Z", "time_start": "2023-11-07T15:06:47.196504Z", "version": "1f5avktpiech0"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350102", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.204855Z", "time_start": "2023-11-07T15:06:47.204855Z", "version": "1f5avktpqc1n0"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350103", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.213917Z", "time_start": "2023-11-07T15:06:47.213917Z", "version": "1f5avktq30m88"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350104", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.222603Z", "time_start": "2023-11-07T15:06:47.222603Z", "version": "1f5avktqb71og"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350105", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.231231Z", "time_start": "2023-11-07T15:06:47.231231Z", "version": "1f5avktqjjbmg"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350106", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.240092Z", "time_start": "2023-11-07T15:06:47.240092Z", "version": "1f5avktqs0g08"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350107", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.248529Z", "time_start": "2023-11-07T15:06:47.248529Z", "version": "1f5avktr41fkg"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350108", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.257414Z", "time_start": "2023-11-07T15:06:47.257414Z", "version": "1f5avktrcku30"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350109", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.266165Z", "time_start": "2023-11-07T15:06:47.266165Z", "version": "1f5avktrksdng"}]}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350100/1f5avktp3qpkg", "initiated_at": "2023-11-07T15:06:47.292875Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.004872, "reported": "2023-11-07T15:06:47.298451Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350100", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.181299Z", "time_start": "2023-11-07T15:06:47.181299Z", "version": "1f5avktp3qpkg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350101/1f5avktpiech0", "initiated_at": "2023-11-07T15:06:47.298918Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.004189, "reported": "2023-11-07T15:06:47.303795Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350101", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.196504Z", "time_start": "2023-11-07T15:06:47.196504Z", "version": "1f5avktpiech0"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350102/1f5avktpqc1n0", "initiated_at": "2023-11-07T15:06:47.304308Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.004133, "reported": "2023-11-07T15:06:47.309201Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350102", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.204855Z", "time_start": "2023-11-07T15:06:47.204855Z", "version": "1f5avktpqc1n0"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350103/1f5avktq30m88", "initiated_at": "2023-11-07T15:06:47.309691Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.004236, "reported": "2023-11-07T15:06:47.314729Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350103", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.213917Z", "time_start": "2023-11-07T15:06:47.213917Z", "version": "1f5avktq30m88"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350104/1f5avktqb71og", "initiated_at": "2023-11-07T15:06:47.315220Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.004, "reported": "2023-11-07T15:06:47.319911Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350104", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.222603Z", "time_start": "2023-11-07T15:06:47.222603Z", "version": "1f5avktqb71og"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350105/1f5avktqjjbmg", "initiated_at": "2023-11-07T15:06:47.320405Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.00417, "reported": "2023-11-07T15:06:47.325319Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350105", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.231231Z", "time_start": "2023-11-07T15:06:47.231231Z", "version": "1f5avktqjjbmg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350106/1f5avktqs0g08", "initiated_at": "2023-11-07T15:06:47.325747Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.005862, "reported": "2023-11-07T15:06:47.332487Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350106", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.240092Z", "time_start": "2023-11-07T15:06:47.240092Z", "version": "1f5avktqs0g08"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350107/1f5avktr41fkg", "initiated_at": "2023-11-07T15:06:47.332917Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.004213, "reported": "2023-11-07T15:06:47.337794Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350107", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.248529Z", "time_start": "2023-11-07T15:06:47.248529Z", "version": "1f5avktr41fkg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350108/1f5avktrcku30", "initiated_at": "2023-11-07T15:06:47.338313Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.004694, "reported": "2023-11-07T15:06:47.343939Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350108", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.257414Z", "time_start": "2023-11-07T15:06:47.257414Z", "version": "1f5avktrcku30"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350109/1f5avktrksdng", "initiated_at": "2023-11-07T15:06:47.344383Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.004735, "reported": "2023-11-07T15:06:47.349804Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350109", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:36:47.266165Z", "time_start": "2023-11-07T15:06:47.266165Z", "version": "1f5avktrksdng"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.350259Z"}], "end_time": "2023-11-07T15:06:47.350292Z"}], "successful": true, "end_time": "2023-11-07T15:06:47.350319Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#cleanup", "start_time": "2023-11-07T15:06:47.350366Z", "failed_checks": [], "passed_checks": [{"name": "Successful subscription search query", "timestamp": "2023-11-07T15:06:47.353848Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:47.350486Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "21"}, "elapsed_s": 0.002212, "reported": "2023-11-07T15:06:47.353418Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.354046Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: Subscription Simple", "scenario_type": "scenarios.astm.netrid.v19.dss.SubscriptionSimple", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md", "start_time": "2023-11-07T15:06:47.354515Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#setup-test-case", "start_time": "2023-11-07T15:06:47.354701Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T15:06:47.354758Z", "failed_checks": [], "passed_checks": [{"name": "Search for all subscriptions in ISA area", "timestamp": "2023-11-07T15:06:47.358065Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T15:06:47.360519Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T15:06:47.362663Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T15:06:47.364594Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T15:06:47.366653Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:47.354864Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "21"}, "elapsed_s": 0.002081, "reported": "2023-11-07T15:06:47.357696Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:47.358287Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "115"}, "elapsed_s": 0.001362, "reported": "2023-11-07T15:06:47.360177Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350000 not found (E:d6b1e5de-989a-4ba8-8870-18c550dfa684)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350001", "initiated_at": "2023-11-07T15:06:47.360617Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "115"}, "elapsed_s": 0.001168, "reported": "2023-11-07T15:06:47.362452Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350001 not found (E:0e50c075-165a-4caf-8f01-99ff33438554)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350002", "initiated_at": "2023-11-07T15:06:47.362761Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "115"}, "elapsed_s": 0.00107, "reported": "2023-11-07T15:06:47.364374Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350002 not found (E:e24c35d9-c8e8-4374-a032-e9abc653678f)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T15:06:47.364691Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "115"}, "elapsed_s": 0.001235, "reported": "2023-11-07T15:06:47.366445Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350003 not found (E:163ceb5f-5087-45cb-8c1e-2bfb4e48e8f7)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.366729Z"}], "end_time": "2023-11-07T15:06:47.366764Z"}, {"name": "Subscription Simple", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#subscription-simple-test-case", "start_time": "2023-11-07T15:06:47.366810Z", "steps": [{"name": "Create subscription validation", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#create-subscription-validation-test-step", "start_time": "2023-11-07T15:06:47.366866Z", "failed_checks": [], "passed_checks": [{"name": "Create subscription", "timestamp": "2023-11-07T15:06:47.375396Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Response to subscription creation contains a subscription", "timestamp": "2023-11-07T15:06:47.376345Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T15:06:47.377109Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T15:06:47.377183Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T15:06:47.377238Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T15:06:47.377286Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T15:06:47.377332Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T15:06:47.377381Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T15:06:47.377427Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T15:06:47.377470Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T15:06:47.377516Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T15:06:47.377594Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T15:06:47.377646Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T15:06:47.377817Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned notification index is 0 if present", "timestamp": "2023-11-07T15:06:47.378645Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T15:06:47.367828Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:31.032702Z", "time_end": "2023-11-07T15:16:31.032702Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "13146f6a-01b7-473c-85b5-46521efc3569"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.005994, "reported": "2023-11-07T15:06:47.374441Z", "json": {"service_areas": [], "subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:16:31.032702Z", "time_start": "2023-11-07T15:06:31.032702Z", "version": "1f5avktul5s5o"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.379543Z"}, {"name": "Mutate Subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#mutate-subscription-test-step", "start_time": "2023-11-07T15:06:47.379709Z", "failed_checks": [], "passed_checks": [{"name": "Subscription can be mutated", "timestamp": "2023-11-07T15:06:47.389123Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Response to subscription mutation contains a subscription", "timestamp": "2023-11-07T15:06:47.390104Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T15:06:47.390899Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T15:06:47.390959Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T15:06:47.391009Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T15:06:47.391057Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T15:06:47.391104Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T15:06:47.391155Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T15:06:47.391200Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T15:06:47.391245Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T15:06:47.391291Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T15:06:47.391337Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T15:06:47.391383Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T15:06:47.391432Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Mutated subscription version is updated", "timestamp": "2023-11-07T15:06:47.391502Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Subscription can be mutated", "timestamp": "2023-11-07T15:06:47.400656Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Response to subscription mutation contains a subscription", "timestamp": "2023-11-07T15:06:47.401604Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T15:06:47.402384Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T15:06:47.402442Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T15:06:47.402495Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T15:06:47.402564Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T15:06:47.402634Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T15:06:47.402704Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T15:06:47.402758Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T15:06:47.402821Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T15:06:47.402889Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T15:06:47.402942Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T15:06:47.403008Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T15:06:47.403078Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Mutated subscription version is updated", "timestamp": "2023-11-07T15:06:47.403152Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/1f5avktul5s5o", "initiated_at": "2023-11-07T15:06:47.380603Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "484", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.032702Z", "time_end": "2023-11-07T15:16:41.032702Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "b5aea47a-210d-4a9d-98da-157945aff289"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.006882, "reported": "2023-11-07T15:06:47.388174Z", "json": {"service_areas": [], "subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:16:41.032702Z", "time_start": "2023-11-07T15:06:41.032702Z", "version": "1f5avktv1e4t8"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/1f5avktv1e4t8", "initiated_at": "2023-11-07T15:06:47.393084Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "506", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.61500000000001}, {"lat": 37.2148, "lng": -80.61500000000001}, {"lat": 37.2148, "lng": -80.545}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T15:06:41.032702Z", "time_end": "2023-11-07T15:16:41.032702Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "a0f1d354-f8b1-4dd9-999d-6d39a5e3cd4d"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "371"}, "elapsed_s": 0.005775, "reported": "2023-11-07T15:06:47.399723Z", "json": {"service_areas": [], "subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:16:41.032702Z", "time_start": "2023-11-07T15:06:41.032702Z", "version": "1f5avktvdkd68"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.403985Z"}, {"name": "Query Existing Subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#query-existing-subscription-test-step", "start_time": "2023-11-07T15:06:47.404018Z", "failed_checks": [], "passed_checks": [{"name": "Get Subscription by ID", "timestamp": "2023-11-07T15:06:47.407814Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T15:06:47.408574Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T15:06:47.408634Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T15:06:47.408685Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T15:06:47.408733Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T15:06:47.408781Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T15:06:47.408831Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T15:06:47.408877Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T15:06:47.408923Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T15:06:47.408971Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T15:06:47.409018Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T15:06:47.409065Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T15:06:47.409114Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Non-mutated subscription keeps the same version", "timestamp": "2023-11-07T15:06:47.409193Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned notification index is equal to or greater than 0", "timestamp": "2023-11-07T15:06:47.409254Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Search for all subscriptions in ISA area", "timestamp": "2023-11-07T15:06:47.412637Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Created Subscription is in search results", "timestamp": "2023-11-07T15:06:47.413475Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T15:06:47.414283Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T15:06:47.414344Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T15:06:47.414395Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T15:06:47.414443Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T15:06:47.414492Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T15:06:47.414543Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T15:06:47.414590Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T15:06:47.414637Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T15:06:47.414685Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T15:06:47.414732Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T15:06:47.414780Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T15:06:47.414830Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Non-mutated subscription keeps the same version", "timestamp": "2023-11-07T15:06:47.414889Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned notification index is equal to or greater than 0", "timestamp": "2023-11-07T15:06:47.414940Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "No huge search area allowed", "timestamp": "2023-11-07T15:06:47.416686Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T15:06:47.404226Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.001333, "reported": "2023-11-07T15:06:47.406245Z", "json": {"subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:16:41.032702Z", "time_start": "2023-11-07T15:06:41.032702Z", "version": "1f5avktvdkd68"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:47.409483Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "355"}, "elapsed_s": 0.001666, "reported": "2023-11-07T15:06:47.411778Z", "json": {"subscriptions": [{"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:16:41.032702Z", "time_start": "2023-11-07T15:06:41.032702Z", "version": "1f5avktvdkd68"}]}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=38.0,-81.0,37.0,-81.0,37.0,-80.0,38.0,-80.0", "initiated_at": "2023-11-07T15:06:47.415009Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 413, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "70"}, "elapsed_s": 0.000827, "reported": "2023-11-07T15:06:47.416466Z", "json": {"message": "Area too large (E:5ecd58e1-35bd-49e6-83e0-d25439e053f6)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.416744Z"}, {"name": "Delete Subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#delete-subscription-test-step", "start_time": "2023-11-07T15:06:47.416795Z", "failed_checks": [], "passed_checks": [{"name": "Missing version prevents deletion", "timestamp": "2023-11-07T15:06:47.418752Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Incorrect version prevents deletion", "timestamp": "2023-11-07T15:06:47.420579Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T15:06:47.428526Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T15:06:47.429361Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T15:06:47.429455Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T15:06:47.429511Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T15:06:47.429582Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T15:06:47.429634Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T15:06:47.429686Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T15:06:47.429732Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T15:06:47.429776Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T15:06:47.429822Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T15:06:47.429868Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T15:06:47.429914Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T15:06:47.429964Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Non-mutated subscription keeps the same version", "timestamp": "2023-11-07T15:06:47.430022Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned notification index is equal to or greater than 0", "timestamp": "2023-11-07T15:06:47.430072Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/", "initiated_at": "2023-11-07T15:06:47.417027Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "78"}, "elapsed_s": 0.000774, "reported": "2023-11-07T15:06:47.418526Z", "json": {"message": "Missing version string (E:471ab1a7-86d0-4614-9253-58bd7c4c842f)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/notacorrectversion", "initiated_at": "2023-11-07T15:06:47.418855Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "125"}, "elapsed_s": 0.000814, "reported": "2023-11-07T15:06:47.420345Z", "json": {"message": "strconv.ParseUint: parsing \"notacorrectversion\": value out of range (E:b78f47a7-dbf7-4f80-be86-564004eb4b60)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/1f5avktvdkd68", "initiated_at": "2023-11-07T15:06:47.420831Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "352"}, "elapsed_s": 0.005063, "reported": "2023-11-07T15:06:47.426667Z", "json": {"subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T15:16:41.032702Z", "time_start": "2023-11-07T15:06:41.032702Z", "version": "1f5avktvdkd68"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.430095Z"}, {"name": "Query Deleted Subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#query-deleted-subscription-test-step", "start_time": "2023-11-07T15:06:47.430120Z", "failed_checks": [], "passed_checks": [{"name": "Query by subscription ID should fail", "timestamp": "2023-11-07T15:06:47.432610Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Search for all subscriptions in ISA area", "timestamp": "2023-11-07T15:06:47.435806Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Deleted subscription should not be present in search results", "timestamp": "2023-11-07T15:06:47.436010Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Search area that represents a loop is not allowed", "timestamp": "2023-11-07T15:06:47.437719Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T15:06:47.430287Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "115"}, "elapsed_s": 0.001371, "reported": "2023-11-07T15:06:47.432339Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350003 not found (E:f77729d7-a106-4bd2-91ec-68b9b59d058a)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T15:06:47.432892Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "21"}, "elapsed_s": 0.001791, "reported": "2023-11-07T15:06:47.435431Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544,37.1853,-80.614", "initiated_at": "2023-11-07T15:06:47.436086Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "103"}, "elapsed_s": 0.000823, "reported": "2023-11-07T15:06:47.437473Z", "json": {"message": "Intersection found between polygon edge 1 and 4 (E:64760176-503a-4359-a892-e807a9748117)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.437772Z"}], "end_time": "2023-11-07T15:06:47.437807Z"}], "successful": true, "end_time": "2023-11-07T15:06:47.437841Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#cleanup", "start_time": "2023-11-07T15:06:47.437885Z", "failed_checks": [], "passed_checks": [{"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T15:06:47.439870Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T15:06:47.442011Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T15:06:47.444057Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T15:06:47.446115Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T15:06:47.437955Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "115"}, "elapsed_s": 0.001153, "reported": "2023-11-07T15:06:47.439653Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350000 not found (E:04e6815a-2139-4ca9-a45d-e31789cb3177)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350001", "initiated_at": "2023-11-07T15:06:47.439978Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "115"}, "elapsed_s": 0.001151, "reported": "2023-11-07T15:06:47.441803Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350001 not found (E:74480ec2-b215-4ecb-a36f-f422fe868533)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350002", "initiated_at": "2023-11-07T15:06:47.442109Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "115"}, "elapsed_s": 0.00114, "reported": "2023-11-07T15:06:47.443852Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350002 not found (E:243b9d84-7cd3-4e15-abd0-d844706bdd34)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T15:06:47.444150Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "115"}, "elapsed_s": 0.001139, "reported": "2023-11-07T15:06:47.445909Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350003 not found (E:605d0240-6895-4a0d-b530-d60a4ccde92a)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T15:06:47.446188Z"}}}, {"test_scenario": {"name": "ASTM F3411-19 NetRID DSS interoperability", "scenario_type": "scenarios.astm.netrid.v19.DSSInteroperability", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss_interoperability.md", "start_time": "2023-11-07T15:06:47.446647Z", "cases": [{"name": "Prerequisites", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss_interoperability.md#prerequisites-test-case", "start_time": "2023-11-07T15:06:47.446714Z", "steps": [{"name": "Test environment requirements", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss_interoperability.md#test-environment-requirements-test-step", "start_time": "2023-11-07T15:06:47.446767Z", "failed_checks": [], "passed_checks": [{"name": "DSS instance is publicly addressable", "timestamp": "2023-11-07T15:06:47.447345Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0210"]}, {"name": "DSS instance is reachable", "timestamp": "2023-11-07T15:06:47.450636Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0210"]}, {"name": "DSS instance is publicly addressable", "timestamp": "2023-11-07T15:06:47.451066Z", "participants": ["uss2"], "requirements": ["astm.f3411.v19.DSS0210"]}, {"name": "DSS instance is reachable", "timestamp": "2023-11-07T15:06:47.455934Z", "participants": ["uss2"], "requirements": ["astm.f3411.v19.DSS0210"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=-23.6558,130.6205,-23.6898,130.6301,-23.6709,130.67,-23.6407,130.6466", "initiated_at": "2023-11-07T15:06:47.447462Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwMSwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "21"}, "elapsed_s": 0.001697, "reported": "2023-11-07T15:06:47.449875Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss2.localutm/v1/dss/subscriptions?area=-23.6558,130.6205,-23.6898,130.6301,-23.6709,130.67,-23.6407,130.6466", "initiated_at": "2023-11-07T15:06:47.451181Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMi5sb2NhbHV0bSIsImV4cCI6MTY5OTM3MzIwNywiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": null, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 15:06:47 GMT", "Content-Length": "21"}, "elapsed_s": 0.002232, "reported": "2023-11-07T15:06:47.455568Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss2"}], "end_time": "2023-11-07T15:06:47.455987Z"}], "end_time": "2023-11-07T15:06:47.456013Z"}, {"name": "Interoperability sequence", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss_interoperability.md#interoperability-sequence-test-case", "start_time": "2023-11-07T15:06:47.456051Z", "steps": [{"name": "S1", "documentation_url": "https://github.com/interuss/monitoring/blob/079c92b67fb65366b165c1512c319174facf3aca/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/put_isa.md#create-or-update-isa-test-step", "start_time": "2023-11-07T15:06:47.456106Z", "failed_checks": [], "passed_checks": [{"name": "ISA[P] created with proper response", "timestamp": "2023-11-07T15:06:47.456185Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0130,A2-6-1,1a"]}]}]}], "successful": false, "notes": {"uss1_private_address": {"message": "DSS instance (URL: http://dss.uss1.localutm, netloc: dss.uss1.localutm, resolved IP: 172.19.0.3) is declared as explicitly having a private address, skipping check", "timestamp": "2023-11-07T15:06:47.447157Z"}, "uss2_private_address": {"message": "DSS instance (URL: http://dss.uss2.localutm, netloc: dss.uss2.localutm, resolved IP: 172.19.0.3) is declared as explicitly having a private address, skipping check", "timestamp": "2023-11-07T15:06:47.450901Z"}}, "execution_error": {"type": "TypeError", "message": "'ExecutionContext' object does not support item assignment", "timestamp": "2023-11-07T15:06:47.456223Z", "stacktrace": "Traceback (most recent call last):\n File \"/app/monitoring/uss_qualifier/suites/suite.py\", line 150, in _run_test_scenario\n scenario.run(context)\n File \"/app/monitoring/uss_qualifier/scenarios/astm/netrid/common/dss_interoperability.py\", line 109, in run\n step()\n File \"/app/monitoring/uss_qualifier/scenarios/astm/netrid/common/dss_interoperability.py\", line 147, in step1\n isa_1 = self._new_isa(\"isa_1\")\n File \"/app/monitoring/uss_qualifier/scenarios/astm/netrid/common/dss_interoperability.py\", line 78, in _new_isa\n self._context[name] = TestEntity(EntityType.ISA, str(uuid.uuid4()))\nTypeError: 'ExecutionContext' object does not support item assignment\n"}}}], "capability_evaluations": [], "successful": false, "end_time": "2023-11-07T15:06:47.456881Z"}}], "generator_type": "action_generators.astm.f3411.ForEachDSS", "start_time": "2023-11-07T15:06:41.438513Z", "successful": false, "end_time": "2023-11-07T15:06:47.457493Z"}}], "capability_evaluations": [], "successful": false, "end_time": "2023-11-07T15:06:47.457782Z"}}} \ No newline at end of file +{"codebase_version": "interuss/monitoring/v0.0.0-1973813", "commit_hash": "197381398d21bc12b7ff83a214ebd548b1048a8c", "baseline_signature": "76b192786744f7eff4581e391eb56d8a679b139020adf0c861477a5a01a49167", "environment_signature": "383670842b90e623e04660bab8132198849a61457e0d90caf9eebb0df6322efb", "configuration": {"resources": {"resource_declarations": {"id_generator": {"resource_type": "resources.interuss.IDGeneratorResource", "dependencies": {"auth_adapter": "utm_auth"}, "specification": {"whoami_audience": "localhost", "whoami_scope": "rid.display_provider"}}, "kentland_service_area": {"resource_type": "resources.netrid.ServiceAreaResource", "specification": {"base_url": "https://uss_qualifier.test.utm/dummy_base_url", "footprint": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}], "altitude_min": 0.0, "altitude_max": 3048.0, "reference_time": "2023-01-10T00:00:00.123456+00:00", "time_start": "2023-01-10T00:00:01.123456+00:00", "time_end": "2023-01-10T01:00:01.123456+00:00"}, "dependencies": {}}, "kentland_problematically_big_area": {"resource_type": "resources.VerticesResource", "specification": {"vertices": [{"lat": 38.0, "lng": -81.0}, {"lat": 37.0, "lng": -81.0}, {"lat": 37.0, "lng": -80.0}, {"lat": 38.0, "lng": -80.0}]}, "dependencies": {}}, "utm_auth": {"resource_type": "resources.communications.AuthAdapterResource", "specification": {"environment_variable_containing_auth_spec": "AUTH_SPEC"}, "dependencies": {}}, "scd_dss_instances": {"resource_type": "resources.astm.f3548.v21.DSSInstancesResource", "dependencies": {"auth_adapter": "utm_auth"}, "specification": {"dss_instances": [{"participant_id": "uss1", "base_url": "http://dss.uss1.localutm", "has_private_address": true}, {"participant_id": "uss2", "base_url": "http://dss.uss2.localutm", "has_private_address": true}]}}, "netrid_dss_instances_v22a": {"resource_type": "resources.astm.f3411.DSSInstancesResource", "dependencies": {"auth_adapter": "utm_auth"}, "specification": {"dss_instances": [{"participant_id": "uss1", "rid_version": "F3411-22a", "base_url": "http://dss.uss1.localutm/rid/v2", "has_private_address": true, "local_debug": true}, {"participant_id": "uss2", "rid_version": "F3411-22a", "base_url": "http://dss.uss2.localutm/rid/v2", "has_private_address": true, "local_debug": true}]}}, "netrid_dss_instances_v19": {"resource_type": "resources.astm.f3411.DSSInstancesResource", "dependencies": {"auth_adapter": "utm_auth"}, "specification": {"dss_instances": [{"participant_id": "uss1", "rid_version": "F3411-19", "base_url": "http://dss.uss1.localutm", "has_private_address": true, "local_debug": true}, {"participant_id": "uss2", "rid_version": "F3411-19", "base_url": "http://dss.uss2.localutm", "has_private_address": true, "local_debug": true}]}}}}, "non_baseline_inputs": ["v1.test_run.resources.resource_declarations.utm_auth", "v1.test_run.resources.resource_declarations.scd_dss_instances", "v1.test_run.resources.resource_declarations.netrid_dss_instances_v22a", "v1.test_run.resources.resource_declarations.netrid_dss_instances_v19"], "action": {"test_suite": {"suite_type": "suites.interuss.dss.all_tests", "resources": {"f3411v19_dss_instances": "netrid_dss_instances_v19", "f3411v22a_dss_instances": "netrid_dss_instances_v22a", "id_generator": "id_generator", "service_area": "kentland_service_area", "problematically_big_area": "kentland_problematically_big_area"}}, "on_failure": "Continue"}, "execution": {"stop_fast": true, "include_action_when": null, "skip_action_when": null}}, "report": {"test_suite": {"name": "ASTM DSS tests", "suite_type": "suites.interuss.dss.all_tests", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/suites/interuss/dss/all_tests.md", "start_time": "2023-11-07T16:57:58.877620Z", "actions": [{"action_generator": {"actions": [{"test_suite": {"name": "DSS testing for ASTM NetRID F3411-19", "suite_type": "suites.astm.netrid.f3411_19.dss_probing", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/suites/astm/netrid/f3411_19/dss_probing.md", "start_time": "2023-11-07T16:57:58.877847Z", "actions": [{"test_scenario": {"name": "ASTM NetRID DSS: Simple ISA", "scenario_type": "scenarios.astm.netrid.v19.dss.ISASimple", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md", "start_time": "2023-11-07T16:57:58.877991Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#setup-test-case", "start_time": "2023-11-07T16:57:58.878048Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T16:57:58.878085Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:57:58.885199Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:58.878132Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:58 GMT", "Content-Length": "106"}, "elapsed_s": 0.003462, "reported": "2023-11-07T16:57:58.884578Z", "json": {"message": "ISA 0000015c-e36d-40be-d38b-eca6ca350000 not found (E:82319058-ca82-4dff-b6e7-bf408426ef93)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:58.885276Z"}], "end_time": "2023-11-07T16:57:58.885297Z"}, {"name": "Create and check ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#create-and-check-isa-test-case", "start_time": "2023-11-07T16:57:58.885333Z", "steps": [{"name": "Create ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/put_isa.md#create-or-update-isa-test-step", "start_time": "2023-11-07T16:57:58.885364Z", "failed_checks": [], "passed_checks": [{"name": "ISA response code", "timestamp": "2023-11-07T16:57:58.914360Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA response format", "timestamp": "2023-11-07T16:57:59.141224Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA ID matches", "timestamp": "2023-11-07T16:57:59.141355Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA version format", "timestamp": "2023-11-07T16:57:59.141416Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA start time matches", "timestamp": "2023-11-07T16:57:59.141472Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA end time matches", "timestamp": "2023-11-07T16:57:59.141523Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA URL matches", "timestamp": "2023-11-07T16:57:59.141576Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA created", "timestamp": "2023-11-07T16:57:59.142073Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:58.886357Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:57:59.287591Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "241f6031-3085-4a78-b2b8-c8d11ae0594c"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:58 GMT", "Content-Length": "291"}, "elapsed_s": 0.020358, "reported": "2023-11-07T16:57:58.909432Z", "json": {"subscribers": [], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:57:59.287591Z", "version": "1f5b5n39f7j1o", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.142106Z"}, {"name": "Get ISA by ID", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#get-isa-by-id-test-step", "start_time": "2023-11-07T16:57:59.142138Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:57:59.146428Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA", "interuss.f3411.dss_endpoints.GetISA"]}, {"name": "ISA version match", "timestamp": "2023-11-07T16:57:59.147126Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.142190Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "274"}, "elapsed_s": 0.002017, "reported": "2023-11-07T16:57:59.144988Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:57:59.287591Z", "version": "1f5b5n39f7j1o", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.147158Z"}], "end_time": "2023-11-07T16:57:59.147176Z"}, {"name": "Update and search ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#update-and-search-isa-test-case", "start_time": "2023-11-07T16:57:59.147215Z", "steps": [{"name": "Update ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/put_isa.md#create-or-update-isa-test-step", "start_time": "2023-11-07T16:57:59.147256Z", "failed_checks": [], "passed_checks": [{"name": "ISA response code", "timestamp": "2023-11-07T16:57:59.157720Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA response format", "timestamp": "2023-11-07T16:57:59.170190Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA ID matches", "timestamp": "2023-11-07T16:57:59.170302Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA version changed", "timestamp": "2023-11-07T16:57:59.170362Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA version format", "timestamp": "2023-11-07T16:57:59.170419Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA start time matches", "timestamp": "2023-11-07T16:57:59.170478Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA end time matches", "timestamp": "2023-11-07T16:57:59.170533Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA URL matches", "timestamp": "2023-11-07T16:57:59.170591Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "ISA updated", "timestamp": "2023-11-07T16:57:59.171070Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000/1f5b5n39f7j1o", "initiated_at": "2023-11-07T16:57:59.147932Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:58:00.287591Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "d49eb30c-ecc3-41c2-afaf-fa0127907283"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "291"}, "elapsed_s": 0.006226, "reported": "2023-11-07T16:57:59.154951Z", "json": {"subscribers": [], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:58:00.287591Z", "version": "1f5b5n3h6pc40", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.171102Z"}, {"name": "Get ISA by ID", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#get-isa-by-id-test-step-1", "start_time": "2023-11-07T16:57:59.171142Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:57:59.175377Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA", "interuss.f3411.dss_endpoints.GetISA"]}, {"name": "ISA version match", "timestamp": "2023-11-07T16:57:59.176058Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.171192Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "274"}, "elapsed_s": 0.002068, "reported": "2023-11-07T16:57:59.174011Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:58:00.287591Z", "version": "1f5b5n3h6pc40", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.176089Z"}, {"name": "Search by earliest time (included)", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T16:57:59.176128Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T16:57:59.193369Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T16:57:59.193428Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA returned by search", "timestamp": "2023-11-07T16:57:59.194258Z", "participants": ["uss1"], "requirements": []}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544&earliest_time=2023-11-07T17:57:00.287591Z", "initiated_at": "2023-11-07T16:57:59.176230Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "277"}, "elapsed_s": 0.003109, "reported": "2023-11-07T16:57:59.180122Z", "json": {"service_areas": [{"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:58:00.287591Z", "version": "1f5b5n3h6pc40", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}]}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.194294Z"}, {"name": "Search by earliest time (excluded)", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T16:57:59.194332Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T16:57:59.209008Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T16:57:59.209065Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA not returned by search", "timestamp": "2023-11-07T16:57:59.209261Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544&earliest_time=2023-11-07T17:59:00.287591Z", "initiated_at": "2023-11-07T16:57:59.194434Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "21"}, "elapsed_s": 0.002212, "reported": "2023-11-07T16:57:59.197402Z", "json": {"service_areas": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.209295Z"}, {"name": "Search by latest time (included)", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T16:57:59.209332Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T16:57:59.225387Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T16:57:59.225445Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA returned by search", "timestamp": "2023-11-07T16:57:59.226259Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544&latest_time=2023-11-07T16:58:59.287591Z", "initiated_at": "2023-11-07T16:57:59.209433Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "277"}, "elapsed_s": 0.002517, "reported": "2023-11-07T16:57:59.212690Z", "json": {"service_areas": [{"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:58:00.287591Z", "version": "1f5b5n3h6pc40", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}]}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.226294Z"}, {"name": "Search by latest time (excluded)", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T16:57:59.226331Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T16:57:59.240932Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T16:57:59.240990Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA not returned by search", "timestamp": "2023-11-07T16:57:59.241189Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544&latest_time=2023-11-07T16:56:59.287591Z", "initiated_at": "2023-11-07T16:57:59.226429Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "21"}, "elapsed_s": 0.002399, "reported": "2023-11-07T16:57:59.229562Z", "json": {"service_areas": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.241222Z"}, {"name": "Search by area only", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T16:57:59.241260Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T16:57:59.257073Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T16:57:59.257130Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA returned by search", "timestamp": "2023-11-07T16:57:59.257944Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:57:59.241343Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "277"}, "elapsed_s": 0.002273, "reported": "2023-11-07T16:57:59.244374Z", "json": {"service_areas": [{"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:58:00.287591Z", "version": "1f5b5n3h6pc40", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}]}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.257978Z"}, {"name": "Search with invalid params", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#search-with-invalid-params-test-step", "start_time": "2023-11-07T16:57:59.258016Z", "failed_checks": [], "passed_checks": [{"name": "Search request rejected", "timestamp": "2023-11-07T16:57:59.260099Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=", "initiated_at": "2023-11-07T16:57:59.258072Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "68"}, "elapsed_s": 0.001053, "reported": "2023-11-07T16:57:59.259813Z", "json": {"message": "Missing area (E:9f41e52a-8007-4d1c-af48-f53a3508b70e)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.260158Z"}, {"name": "Search by huge area", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#search-by-huge-area-test-step", "start_time": "2023-11-07T16:57:59.260197Z", "failed_checks": [], "passed_checks": [{"name": "Search request rejected", "timestamp": "2023-11-07T16:57:59.262333Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=38.0,-81.0,37.0,-81.0,37.0,-80.0,38.0,-80.0", "initiated_at": "2023-11-07T16:57:59.260292Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 413, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "70"}, "elapsed_s": 0.001107, "reported": "2023-11-07T16:57:59.262064Z", "json": {"message": "Area too large (E:443bcbfa-2d3a-497e-a24d-7950f341532d)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.262370Z"}, {"name": "Search ISA with loop", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#search-isa-with-loop-test-step", "start_time": "2023-11-07T16:57:59.262404Z", "failed_checks": [], "passed_checks": [{"name": "Search request rejected", "timestamp": "2023-11-07T16:57:59.264398Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544,37.1853,-80.614", "initiated_at": "2023-11-07T16:57:59.262479Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "103"}, "elapsed_s": 0.001005, "reported": "2023-11-07T16:57:59.264119Z", "json": {"message": "Intersection found between polygon edge 1 and 4 (E:860d0bb1-f25c-4921-925a-d52701cf2fb8)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.264459Z"}], "end_time": "2023-11-07T16:57:59.264479Z"}, {"name": "Delete ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#delete-isa-test-case", "start_time": "2023-11-07T16:57:59.264536Z", "steps": [{"name": "Delete with wrong version", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#delete-with-wrong-version-test-step", "start_time": "2023-11-07T16:57:59.264573Z", "failed_checks": [], "passed_checks": [{"name": "Delete request rejected", "timestamp": "2023-11-07T16:57:59.268119Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000/f5b5n3h6pc4", "initiated_at": "2023-11-07T16:57:59.264626Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "body": null, "json": null}, "response": {"code": 409, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "127"}, "elapsed_s": 0.002564, "reported": "2023-11-07T16:57:59.267824Z", "json": {"message": "ISA currently at version 1f5b5n3h6pc40 but client specified f5b5n3h6pc4 (E:0868fd3f-4b90-4f6d-95d5-833f39925124)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.268155Z"}, {"name": "Delete with empty version", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#delete-with-empty-version-test-step", "start_time": "2023-11-07T16:57:59.268186Z", "failed_checks": [], "passed_checks": [{"name": "Delete request rejected", "timestamp": "2023-11-07T16:57:59.270191Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000/", "initiated_at": "2023-11-07T16:57:59.268235Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "body": null, "json": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "78"}, "elapsed_s": 0.000947, "reported": "2023-11-07T16:57:59.269912Z", "json": {"message": "Missing version string (E:f4abc8f6-3d02-4cd8-a46d-9594fa7e0ac7)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.270248Z"}, {"name": "Delete ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/delete_isa.md#delete-isa-test-step", "start_time": "2023-11-07T16:57:59.270281Z", "failed_checks": [], "passed_checks": [{"name": "ISA response format", "timestamp": "2023-11-07T16:57:59.292115Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}, {"name": "ISA ID matches", "timestamp": "2023-11-07T16:57:59.292210Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}, {"name": "ISA version matches", "timestamp": "2023-11-07T16:57:59.292262Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}, {"name": "ISA deleted", "timestamp": "2023-11-07T16:57:59.292290Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000/1f5b5n3h6pc40", "initiated_at": "2023-11-07T16:57:59.270444Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "291"}, "elapsed_s": 0.005842, "reported": "2023-11-07T16:57:59.276912Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.287591Z", "time_end": "2023-11-07T17:58:00.287591Z", "version": "1f5b5n3h6pc40", "id": "0000015c-e36d-40be-d38b-eca6ca350000"}, "subscribers": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.292313Z"}, {"name": "Get deleted ISA by ID", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#get-deleted-isa-by-id-test-step", "start_time": "2023-11-07T16:57:59.292342Z", "failed_checks": [], "passed_checks": [{"name": "ISA not found", "timestamp": "2023-11-07T16:57:59.295043Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.292409Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "106"}, "elapsed_s": 0.001662, "reported": "2023-11-07T16:57:59.294762Z", "json": {"message": "ISA 0000015c-e36d-40be-d38b-eca6ca350000 not found (E:2c5f2f1e-072b-429a-9ff5-9c26414c8442)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.295106Z"}, {"name": "Search ISA", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/search_isas.md#search-isas-test-step", "start_time": "2023-11-07T16:57:59.295139Z", "failed_checks": [], "passed_checks": [{"name": "ISAs search response format", "timestamp": "2023-11-07T16:57:59.309482Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "Successful ISAs search", "timestamp": "2023-11-07T16:57:59.309538Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "ISA not returned by search", "timestamp": "2023-11-07T16:57:59.309743Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:57:59.295338Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "21"}, "elapsed_s": 0.002013, "reported": "2023-11-07T16:57:59.298027Z", "json": {"service_areas": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.309776Z"}], "end_time": "2023-11-07T16:57:59.309795Z"}], "successful": true, "end_time": "2023-11-07T16:57:59.309812Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_simple.md#cleanup", "start_time": "2023-11-07T16:57:59.309840Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:57:59.312476Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/0000015c-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.309876Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "106"}, "elapsed_s": 0.001588, "reported": "2023-11-07T16:57:59.312132Z", "json": {"message": "ISA 0000015c-e36d-40be-d38b-eca6ca350000 not found (E:d1777188-bb78-47d8-a09e-cc28bf023378)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.312551Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: Submitted ISA Validations", "scenario_type": "scenarios.astm.netrid.v19.dss.ISAValidation", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md", "start_time": "2023-11-07T16:57:59.313446Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#setup-test-case", "start_time": "2023-11-07T16:57:59.313510Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T16:57:59.313545Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:57:59.316096Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.313583Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "106"}, "elapsed_s": 0.001548, "reported": "2023-11-07T16:57:59.315793Z", "json": {"message": "ISA 00000170-e36d-40be-d38b-eca6ca350000 not found (E:6d642f34-690c-4f71-9bb9-3ad500b662d9)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.316151Z"}], "end_time": "2023-11-07T16:57:59.316373Z"}, {"name": "ISA Validation", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#isa-validation-test-case", "start_time": "2023-11-07T16:57:59.316405Z", "steps": [{"name": "ISA Validation", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#isa-validation-test-step", "start_time": "2023-11-07T16:57:59.316436Z", "failed_checks": [], "passed_checks": [{"name": "ISA huge area", "timestamp": "2023-11-07T16:57:59.319313Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA empty vertices", "timestamp": "2023-11-07T16:57:59.323023Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA start time in the past", "timestamp": "2023-11-07T16:57:59.326309Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA start time after end time", "timestamp": "2023-11-07T16:57:59.329823Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA vertices are valid", "timestamp": "2023-11-07T16:57:59.332974Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA missing outline", "timestamp": "2023-11-07T16:57:59.335155Z", "participants": ["uss1"], "requirements": []}, {"name": "ISA missing volume", "timestamp": "2023-11-07T16:57:59.337474Z", "participants": ["uss1"], "requirements": []}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.317212Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "442", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 38.0, "lng": -81.0}, {"lat": 37.0, "lng": -81.0}, {"lat": 37.0, "lng": -80.0}, {"lat": 38.0, "lng": -80.0}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:59.305632Z", "time_end": "2023-11-07T17:57:59.305632Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "8e848720-a505-4e03-950a-81db0c21f74f"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "70"}, "elapsed_s": 0.001073, "reported": "2023-11-07T16:57:59.318980Z", "json": {"message": "Area too large (E:934cada7-947e-444f-9a96-48d454b63508)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.320071Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "328", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": []}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:59.305632Z", "time_end": "2023-11-07T17:57:59.305632Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "147ea8f5-1f19-4f34-a5fa-7af9d6f37f9d"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "93"}, "elapsed_s": 0.001864, "reported": "2023-11-07T16:57:59.322681Z", "json": {"message": "Missing or malformed required extents (E:296d7584-24e2-496d-8d28-1eac98bc4bda)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.323901Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:47:59.323063Z", "time_end": "2023-11-07T17:47:59.323063Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "94d77b78-d52c-4604-8fe1-9883e6bc7212"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "116"}, "elapsed_s": 0.001252, "reported": "2023-11-07T16:57:59.325902Z", "json": {"message": "IdentificationServiceArea time_start must not be in the past (E:6c5c6abb-0f33-404d-b025-bc06ea4c8afa)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.327286Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-01-10T01:00:01.123456Z", "time_end": "2023-01-10T00:00:01.123456Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "1729fdbd-0fda-4a74-874a-4d362da9fa18"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "116"}, "elapsed_s": 0.001338, "reported": "2023-11-07T16:57:59.329408Z", "json": {"message": "IdentificationServiceArea time_start must not be in the past (E:c9878479-bf97-4799-b05c-1cb5d72d4a35)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.330803Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "474", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 130.0, "lng": -23.0}, {"lat": 130.0, "lng": -24.000000000000004}, {"lat": 132.0, "lng": -24.000000000000004}, {"lat": 132.0, "lng": -23.0}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-01-10T00:00:01.123456Z", "time_end": "2023-01-10T01:00:01.123456Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "f7fefc45-12a5-4ae2-987c-e6c3e470689d"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "101"}, "elapsed_s": 0.001149, "reported": "2023-11-07T16:57:59.332648Z", "json": {"message": "Coordinates did not create a well-formed area (E:03bf8ec2-cc3f-41bb-b1f5-90e38ed2a3d6)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.333246Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "297", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:59.305632Z", "time_end": "2023-11-07T17:57:59.305632Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "8e848720-a505-4e03-950a-81db0c21f74f"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "93"}, "elapsed_s": 0.001012, "reported": "2023-11-07T16:57:59.334902Z", "json": {"message": "Missing or malformed required extents (E:6965bea3-8829-40b2-b7b7-8bda93d4e6a8)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.335431Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "234", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"time_start": "2023-11-07T16:57:59.305632Z", "time_end": "2023-11-07T17:57:59.305632Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "8e848720-a505-4e03-950a-81db0c21f74f"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "93"}, "elapsed_s": 0.001051, "reported": "2023-11-07T16:57:59.337160Z", "json": {"message": "Missing or malformed required extents (E:612fe18e-1d99-4580-8063-41e3cc4d3edd)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.337586Z"}], "end_time": "2023-11-07T16:57:59.337721Z"}], "successful": true, "end_time": "2023-11-07T16:57:59.337741Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_validation.md#cleanup", "start_time": "2023-11-07T16:57:59.337770Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:57:59.340551Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000170-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.337822Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "106"}, "elapsed_s": 0.001742, "reported": "2023-11-07T16:57:59.340233Z", "json": {"message": "ISA 00000170-e36d-40be-d38b-eca6ca350000 not found (E:ec549619-7cdd-4c62-af21-0beb4fe8531c)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.340735Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: ISA Expiry", "scenario_type": "scenarios.astm.netrid.v19.dss.ISAExpiry", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md", "start_time": "2023-11-07T16:57:59.341230Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#setup-test-case", "start_time": "2023-11-07T16:57:59.341309Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T16:57:59.341375Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:57:59.343867Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.341414Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "106"}, "elapsed_s": 0.001535, "reported": "2023-11-07T16:57:59.343571Z", "json": {"message": "ISA 00000171-e36d-40be-d38b-eca6ca350000 not found (E:e29a31e9-be1e-4501-99bc-9f38e6937c89)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:57:59.343961Z"}], "end_time": "2023-11-07T16:57:59.343982Z"}, {"name": "ISA Expiry", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#isa-expiry-test-case", "start_time": "2023-11-07T16:57:59.344012Z", "steps": [{"name": "ISA Expiry", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#isa-expiry-test-step", "start_time": "2023-11-07T16:57:59.344042Z", "failed_checks": [], "passed_checks": [{"name": "Create short-lived ISA", "timestamp": "2023-11-07T16:57:59.354259Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Expired ISAs are not part of search results", "timestamp": "2023-11-07T16:58:04.362791Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.SearchISAs"]}, {"name": "An expired ISA can be queried by its ID", "timestamp": "2023-11-07T16:58:04.366550Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:57:59.344793Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:59.344065Z", "time_end": "2023-11-07T16:58:04.344065Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "b4f2e633-08ce-4e46-9ace-7236415e6bc4"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:57:59 GMT", "Content-Length": "291"}, "elapsed_s": 0.006679, "reported": "2023-11-07T16:57:59.352174Z", "json": {"subscribers": [], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.344065Z", "time_end": "2023-11-07T16:58:04.344065Z", "version": "1f5b5n3n29sn8", "id": "00000171-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:58:04.358899Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "21"}, "elapsed_s": 0.002461, "reported": "2023-11-07T16:58:04.362279Z", "json": {"service_areas": []}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.362869Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "274"}, "elapsed_s": 0.001654, "reported": "2023-11-07T16:58:04.365198Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.344065Z", "time_end": "2023-11-07T16:58:04.344065Z", "version": "1f5b5n3n29sn8", "id": "00000171-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.366590Z"}], "end_time": "2023-11-07T16:58:04.366609Z"}], "successful": true, "end_time": "2023-11-07T16:58:04.366626Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_expiry.md#cleanup", "start_time": "2023-11-07T16:58:04.366654Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:58:04.369493Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}, {"name": "Removed pre-existing ISA", "timestamp": "2023-11-07T16:58:04.378878Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.366690Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "274"}, "elapsed_s": 0.001475, "reported": "2023-11-07T16:58:04.368806Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.344065Z", "time_end": "2023-11-07T16:58:04.344065Z", "version": "1f5b5n3n29sn8", "id": "00000171-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000171-e36d-40be-d38b-eca6ca350000/1f5b5n3n29sn8", "initiated_at": "2023-11-07T16:58:04.370511Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "291"}, "elapsed_s": 0.005359, "reported": "2023-11-07T16:58:04.376533Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.344065Z", "time_end": "2023-11-07T16:58:04.344065Z", "version": "1f5b5n3n29sn8", "id": "00000171-e36d-40be-d38b-eca6ca350000"}, "subscribers": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.378920Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: ISA Subscription Interactions", "scenario_type": "scenarios.astm.netrid.v19.dss.ISASubscriptionInteractions", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md", "start_time": "2023-11-07T16:58:04.379333Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#setup-test-case", "start_time": "2023-11-07T16:58:04.379388Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T16:58:04.379422Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:58:04.381941Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}, {"name": "Successful subscription search query", "timestamp": "2023-11-07T16:58:04.385994Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.379459Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "106"}, "elapsed_s": 0.001456, "reported": "2023-11-07T16:58:04.381566Z", "json": {"message": "ISA 00000172-e36d-40be-d38b-eca6ca350000 not found (E:e3027f4e-1d94-4400-80e4-d9103b61ad1b)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:58:04.382057Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "21"}, "elapsed_s": 0.002712, "reported": "2023-11-07T16:58:04.385424Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.386145Z"}], "end_time": "2023-11-07T16:58:04.386168Z"}, {"name": "ISA Subscription Interactions", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#isa-subscription-interactions-test-case", "start_time": "2023-11-07T16:58:04.386201Z", "steps": [{"name": "ISA Subscription Interactions", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#isa-subscription-interactions-test-step", "start_time": "2023-11-07T16:58:04.386237Z", "failed_checks": [], "passed_checks": [{"name": "Create an ISA", "timestamp": "2023-11-07T16:58:04.395140Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Create a subscription within the ISA footprint", "timestamp": "2023-11-07T16:58:04.406578Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Subscription for the ISA's area mentions the ISA", "timestamp": "2023-11-07T16:58:04.407637Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Newly created subscription has a notification_index of 0", "timestamp": "2023-11-07T16:58:04.409146Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Mutate the ISA", "timestamp": "2023-11-07T16:58:04.471270Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Response to the mutation of the ISA contains subscription ID", "timestamp": "2023-11-07T16:58:04.474028Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Subscription to an ISA has its notification index incremented after mutation", "timestamp": "2023-11-07T16:58:04.475360Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Delete the ISA", "timestamp": "2023-11-07T16:58:04.505679Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Response to the deletion of the ISA contains subscription ID", "timestamp": "2023-11-07T16:58:04.508948Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,b"]}, {"name": "Subscription to an ISA has its notification index incremented after deletion", "timestamp": "2023-11-07T16:58:04.510287Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,a"]}, {"name": "Successful subscription deletion", "timestamp": "2023-11-07T16:58:04.520629Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.386962Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:59.351791Z", "time_end": "2023-11-07T17:57:59.351791Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "9ae37566-0e37-483a-bb7f-43dff02ac0c5"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "291"}, "elapsed_s": 0.005424, "reported": "2023-11-07T16:58:04.393101Z", "json": {"subscribers": [], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.351791Z", "time_end": "2023-11-07T17:57:59.351791Z", "version": "1f5b5n8daufg8", "id": "00000172-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000172-e36d-40be-d38b-eca6ca350001", "initiated_at": "2023-11-07T16:58:04.395836Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:59.351791Z", "time_end": "2023-11-07T17:57:59.351791Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "b4bf3890-1d3f-4a50-8b30-75f708344b5b"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "627"}, "elapsed_s": 0.008521, "reported": "2023-11-07T16:58:04.405104Z", "json": {"service_areas": [{"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.351791Z", "time_end": "2023-11-07T17:57:59.351791Z", "version": "1f5b5n8daufg8", "id": "00000172-e36d-40be-d38b-eca6ca350000"}], "subscription": {"id": "00000172-e36d-40be-d38b-eca6ca350001", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:57:59.351791Z", "time_start": "2023-11-07T16:57:59.351791Z", "version": "1f5b5n8djffqo"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000/1f5b5n8daufg8", "initiated_at": "2023-11-07T16:58:04.410153Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "462", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3047.0}, "time_start": "2023-11-07T16:57:59.351791Z", "time_end": "2023-11-07T17:57:59.351791Z"}, "flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "request_id": "f14e1dfc-17be-41d5-a408-ddf93cfac2e4"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "482"}, "elapsed_s": 0.005512, "reported": "2023-11-07T16:58:04.416492Z", "json": {"subscribers": [{"subscriptions": [{"subscription_id": "00000172-e36d-40be-d38b-eca6ca350001", "notification_index": 1}], "url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}], "service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.351791Z", "time_end": "2023-11-07T17:57:59.351791Z", "version": "1f5b5n8e19ia8", "id": "00000172-e36d-40be-d38b-eca6ca350000"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000/1f5b5n8e19ia8", "initiated_at": "2023-11-07T16:58:04.476218Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy53cml0ZS5pZGVudGlmaWNhdGlvbl9zZXJ2aWNlX2FyZWFzIiwic3ViIjoidXNzX3F1YWxpZmllciJ9.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "482"}, "elapsed_s": 0.006676, "reported": "2023-11-07T16:58:04.483709Z", "json": {"service_area": {"flights_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/flights", "owner": "uss_qualifier", "time_start": "2023-11-07T16:57:59.351791Z", "time_end": "2023-11-07T17:57:59.351791Z", "version": "1f5b5n8e19ia8", "id": "00000172-e36d-40be-d38b-eca6ca350000"}, "subscribers": [{"subscriptions": [{"subscription_id": "00000172-e36d-40be-d38b-eca6ca350001", "notification_index": 2}], "url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}]}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000172-e36d-40be-d38b-eca6ca350001/1f5b5n8djffqo", "initiated_at": "2023-11-07T16:58:04.511608Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.006003, "reported": "2023-11-07T16:58:04.518378Z", "json": {"subscription": {"id": "00000172-e36d-40be-d38b-eca6ca350001", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 2, "time_end": "2023-11-07T17:57:59.351791Z", "time_start": "2023-11-07T16:57:59.351791Z", "version": "1f5b5n8djffqo"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.520679Z"}], "end_time": "2023-11-07T16:58:04.520700Z"}], "successful": true, "end_time": "2023-11-07T16:58:04.520718Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/isa_subscription_interactions.md#cleanup", "start_time": "2023-11-07T16:58:04.520747Z", "failed_checks": [], "passed_checks": [{"name": "Successful ISA query", "timestamp": "2023-11-07T16:58:04.523409Z", "participants": ["uss1"], "requirements": ["interuss.f3411.dss_endpoints.GetISA"]}, {"name": "Successful subscription search query", "timestamp": "2023-11-07T16:58:04.527680Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/identification_service_areas/00000172-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.520787Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "106"}, "elapsed_s": 0.001565, "reported": "2023-11-07T16:58:04.523085Z", "json": {"message": "ISA 00000172-e36d-40be-d38b-eca6ca350000 not found (E:7e6f43cd-ae8f-49f1-841c-bfa846a69a39)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:58:04.524079Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "21"}, "elapsed_s": 0.001972, "reported": "2023-11-07T16:58:04.526799Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.527852Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: Subscription Validation", "scenario_type": "scenarios.astm.netrid.v19.dss.SubscriptionValidation", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md", "start_time": "2023-11-07T16:58:04.528609Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#setup-test-case", "start_time": "2023-11-07T16:58:04.528997Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T16:58:04.529045Z", "failed_checks": [], "passed_checks": [{"name": "Successful subscription search query", "timestamp": "2023-11-07T16:58:04.532495Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:58:04.529128Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "21"}, "elapsed_s": 0.001826, "reported": "2023-11-07T16:58:04.531613Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.532667Z"}], "end_time": "2023-11-07T16:58:04.532690Z"}, {"name": "Subscription duration limitations", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#subscription-duration-limitations-test-case", "start_time": "2023-11-07T16:58:04.532719Z", "steps": [{"name": "Try to create too-long subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#try-to-create-too-long-subscription-test-step", "start_time": "2023-11-07T16:58:04.532752Z", "failed_checks": [], "passed_checks": [{"name": "Too-long subscription creation rejected", "timestamp": "2023-11-07T16:58:04.535763Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.533499Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.532797Z", "time_end": "2023-11-08T17:08:04.532797Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "645abc58-2c24-4842-bee1-949b7ea2c107"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "92"}, "elapsed_s": 0.00123, "reported": "2023-11-07T16:58:04.535417Z", "json": {"message": "Subscription window exceeds 24 hours (E:e2c4aba7-f026-4196-8e49-cf43ea8f2d86)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.535803Z"}, {"name": "Try to extend subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#try-to-extend-subscription-test-step", "start_time": "2023-11-07T16:58:04.536282Z", "failed_checks": [], "passed_checks": [{"name": "Valid subscription created", "timestamp": "2023-11-07T16:58:04.545573Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Subscription duration limited during update", "timestamp": "2023-11-07T16:58:04.548523Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.537063Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.536334Z", "time_end": "2023-11-08T16:57:04.536334Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "09cfb36c-557f-4299-a473-42606990ade6"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.006537, "reported": "2023-11-07T16:58:04.544285Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350000", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-08T16:57:04.536334Z", "time_start": "2023-11-07T16:58:04.536334Z", "version": "1f5b5n8hq1ml8"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.546274Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.545633Z", "time_end": "2023-11-08T17:08:04.545633Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "85b6400d-e14a-4cc2-a32a-1822a666256f"}, "body": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "92"}, "elapsed_s": 0.001197, "reported": "2023-11-07T16:58:04.548175Z", "json": {"message": "Subscription window exceeds 24 hours (E:fcbaf04d-05c7-4542-8160-cc30c4de9374)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.548563Z"}, {"name": "Remove subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#remove-subscription-test-step", "start_time": "2023-11-07T16:58:04.548685Z", "failed_checks": [], "passed_checks": [{"name": "Subscription deleted", "timestamp": "2023-11-07T16:58:04.556630Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350000/1f5b5n8hq1ml8", "initiated_at": "2023-11-07T16:58:04.549637Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.004662, "reported": "2023-11-07T16:58:04.554965Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350000", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-08T16:57:04.536334Z", "time_start": "2023-11-07T16:58:04.536334Z", "version": "1f5b5n8hq1ml8"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.556668Z"}], "end_time": "2023-11-07T16:58:04.556688Z"}, {"name": "Subscription quantity limitations", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#subscription-quantity-limitations-test-case", "start_time": "2023-11-07T16:58:04.556720Z", "steps": [{"name": "Create maximum number of subscriptions", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#create-maximum-number-of-subscriptions-test-step", "start_time": "2023-11-07T16:58:04.556754Z", "failed_checks": [], "passed_checks": [{"name": "Create up to the maximum allowed number of subscriptions in an area", "timestamp": "2023-11-07T16:58:04.656411Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350100", "initiated_at": "2023-11-07T16:58:04.557431Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.556803Z", "time_end": "2023-11-07T17:28:04.556803Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "ebd3c5a9-cc12-4c4c-a420-9310e8902cca"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.007445, "reported": "2023-11-07T16:58:04.565593Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350100", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.556803Z", "time_start": "2023-11-07T16:58:04.556803Z", "version": "1f5b5n8idi52o"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350101", "initiated_at": "2023-11-07T16:58:04.567164Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.566524Z", "time_end": "2023-11-07T17:28:04.566524Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "554b8efd-9866-4626-ab0d-708e355cfbdc"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.007128, "reported": "2023-11-07T16:58:04.575015Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350101", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.566524Z", "time_start": "2023-11-07T16:58:04.566524Z", "version": "1f5b5n8imsht8"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350102", "initiated_at": "2023-11-07T16:58:04.576531Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.575874Z", "time_end": "2023-11-07T17:28:04.575874Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "b8c7b166-6510-4757-9b3f-9a223c1aaf05"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.007862, "reported": "2023-11-07T16:58:04.585137Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350102", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.575874Z", "time_start": "2023-11-07T16:58:04.575874Z", "version": "1f5b5n8ivp4bg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350103", "initiated_at": "2023-11-07T16:58:04.586701Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.586052Z", "time_end": "2023-11-07T17:28:04.586052Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "e0c0a6f6-7efb-4190-af80-72ff3e09bc15"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.007522, "reported": "2023-11-07T16:58:04.594981Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350103", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.586052Z", "time_start": "2023-11-07T16:58:04.586052Z", "version": "1f5b5n8j9i210"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350104", "initiated_at": "2023-11-07T16:58:04.596586Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.595925Z", "time_end": "2023-11-07T17:28:04.595925Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "9c9b2a7c-12ea-450f-98fa-3dcecbd42b11"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.007176, "reported": "2023-11-07T16:58:04.604537Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350104", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.595925Z", "time_start": "2023-11-07T16:58:04.595925Z", "version": "1f5b5n8jiudbg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350105", "initiated_at": "2023-11-07T16:58:04.606118Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.605472Z", "time_end": "2023-11-07T17:28:04.605472Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "446238d0-3358-4064-b416-4ffa9f69a74c"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.007708, "reported": "2023-11-07T16:58:04.614571Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350105", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.605472Z", "time_start": "2023-11-07T16:58:04.605472Z", "version": "1f5b5n8js3dao"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350106", "initiated_at": "2023-11-07T16:58:04.616151Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.615510Z", "time_end": "2023-11-07T17:28:04.615510Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "50268b66-66e7-457b-a9db-6138795f335b"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "369"}, "elapsed_s": 0.008013, "reported": "2023-11-07T16:58:04.624934Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350106", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.61551Z", "time_start": "2023-11-07T16:58:04.61551Z", "version": "1f5b5n8k5jeqg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350107", "initiated_at": "2023-11-07T16:58:04.626446Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.625808Z", "time_end": "2023-11-07T17:28:04.625808Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "d3283881-db83-4dd5-a5c6-e8c5efc7511c"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.008389, "reported": "2023-11-07T16:58:04.635583Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350107", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.625808Z", "time_start": "2023-11-07T16:58:04.625808Z", "version": "1f5b5n8kfehqo"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350108", "initiated_at": "2023-11-07T16:58:04.637188Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.636546Z", "time_end": "2023-11-07T17:28:04.636546Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "0d886a9b-8a6f-4d89-a6ab-03265157f8ed"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.007649, "reported": "2023-11-07T16:58:04.645592Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350108", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.636546Z", "time_start": "2023-11-07T16:58:04.636546Z", "version": "1f5b5n8kpn2h0"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350109", "initiated_at": "2023-11-07T16:58:04.647297Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.646659Z", "time_end": "2023-11-07T17:28:04.646659Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "ec8ad838-8f7f-4eac-b98b-e3df8899e857"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "371"}, "elapsed_s": 0.007448, "reported": "2023-11-07T16:58:04.655490Z", "json": {"service_areas": [], "subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350109", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.646659Z", "time_start": "2023-11-07T16:58:04.646659Z", "version": "1f5b5n8l3bgko"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.656452Z"}, {"name": "Exceed maximum number of subscriptions", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#exceed-maximum-number-of-subscriptions-test-step", "start_time": "2023-11-07T16:58:04.656485Z", "failed_checks": [], "passed_checks": [{"name": "Enforce maximum number of subscriptions for an area", "timestamp": "2023-11-07T16:58:04.662204Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0050"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350200", "initiated_at": "2023-11-07T16:58:04.657172Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:58:04.656537Z", "time_end": "2023-11-07T17:28:04.656537Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "ea0eb09e-2d51-46cc-9bbf-2d46f0514ce1"}, "body": null}, "response": {"code": 429, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "108"}, "elapsed_s": 0.003986, "reported": "2023-11-07T16:58:04.661892Z", "json": {"message": "Too many existing subscriptions in this area already (E:9b4dc7da-0270-43ea-afb7-7fe197422fdc)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.662269Z"}, {"name": "Clean up subscriptions", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#clean-up-subscriptions-test-step", "start_time": "2023-11-07T16:58:04.662324Z", "failed_checks": [], "passed_checks": [{"name": "Successful subscription search query", "timestamp": "2023-11-07T16:58:04.670788Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.683673Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.690702Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.697785Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.704768Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.711591Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.719409Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.726422Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.738249Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.750544Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.763578Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:58:04.662415Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Transfer-Encoding": "chunked"}, "elapsed_s": 0.002508, "reported": "2023-11-07T16:58:04.665611Z", "json": {"subscriptions": [{"id": "0000016f-e36d-40be-d38b-eca6ca350100", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.556803Z", "time_start": "2023-11-07T16:58:04.556803Z", "version": "1f5b5n8idi52o"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350101", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.566524Z", "time_start": "2023-11-07T16:58:04.566524Z", "version": "1f5b5n8imsht8"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350102", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.575874Z", "time_start": "2023-11-07T16:58:04.575874Z", "version": "1f5b5n8ivp4bg"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350103", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.586052Z", "time_start": "2023-11-07T16:58:04.586052Z", "version": "1f5b5n8j9i210"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350104", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.595925Z", "time_start": "2023-11-07T16:58:04.595925Z", "version": "1f5b5n8jiudbg"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350105", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.605472Z", "time_start": "2023-11-07T16:58:04.605472Z", "version": "1f5b5n8js3dao"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350106", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.61551Z", "time_start": "2023-11-07T16:58:04.61551Z", "version": "1f5b5n8k5jeqg"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350107", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.625808Z", "time_start": "2023-11-07T16:58:04.625808Z", "version": "1f5b5n8kfehqo"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350108", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.636546Z", "time_start": "2023-11-07T16:58:04.636546Z", "version": "1f5b5n8kpn2h0"}, {"id": "0000016f-e36d-40be-d38b-eca6ca350109", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.646659Z", "time_start": "2023-11-07T16:58:04.646659Z", "version": "1f5b5n8l3bgko"}]}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350100/1f5b5n8idi52o", "initiated_at": "2023-11-07T16:58:04.677158Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.005491, "reported": "2023-11-07T16:58:04.683363Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350100", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.556803Z", "time_start": "2023-11-07T16:58:04.556803Z", "version": "1f5b5n8idi52o"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350101/1f5b5n8imsht8", "initiated_at": "2023-11-07T16:58:04.683816Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.005387, "reported": "2023-11-07T16:58:04.690404Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350101", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.566524Z", "time_start": "2023-11-07T16:58:04.566524Z", "version": "1f5b5n8imsht8"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350102/1f5b5n8ivp4bg", "initiated_at": "2023-11-07T16:58:04.690838Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.005951, "reported": "2023-11-07T16:58:04.697489Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350102", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.575874Z", "time_start": "2023-11-07T16:58:04.575874Z", "version": "1f5b5n8ivp4bg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350103/1f5b5n8j9i210", "initiated_at": "2023-11-07T16:58:04.697923Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.005637, "reported": "2023-11-07T16:58:04.704297Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350103", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.586052Z", "time_start": "2023-11-07T16:58:04.586052Z", "version": "1f5b5n8j9i210"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350104/1f5b5n8jiudbg", "initiated_at": "2023-11-07T16:58:04.704906Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.005731, "reported": "2023-11-07T16:58:04.711308Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350104", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.595925Z", "time_start": "2023-11-07T16:58:04.595925Z", "version": "1f5b5n8jiudbg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350105/1f5b5n8js3dao", "initiated_at": "2023-11-07T16:58:04.711767Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.006526, "reported": "2023-11-07T16:58:04.719053Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350105", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.605472Z", "time_start": "2023-11-07T16:58:04.605472Z", "version": "1f5b5n8js3dao"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350106/1f5b5n8k5jeqg", "initiated_at": "2023-11-07T16:58:04.719600Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "350"}, "elapsed_s": 0.005626, "reported": "2023-11-07T16:58:04.725960Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350106", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.61551Z", "time_start": "2023-11-07T16:58:04.61551Z", "version": "1f5b5n8k5jeqg"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350107/1f5b5n8kfehqo", "initiated_at": "2023-11-07T16:58:04.726510Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.010359, "reported": "2023-11-07T16:58:04.737628Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350107", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.625808Z", "time_start": "2023-11-07T16:58:04.625808Z", "version": "1f5b5n8kfehqo"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350108/1f5b5n8kpn2h0", "initiated_at": "2023-11-07T16:58:04.738360Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.01076, "reported": "2023-11-07T16:58:04.749893Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350108", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.636546Z", "time_start": "2023-11-07T16:58:04.636546Z", "version": "1f5b5n8kpn2h0"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/0000016f-e36d-40be-d38b-eca6ca350109/1f5b5n8l3bgko", "initiated_at": "2023-11-07T16:58:04.750660Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "352"}, "elapsed_s": 0.011519, "reported": "2023-11-07T16:58:04.762954Z", "json": {"subscription": {"id": "0000016f-e36d-40be-d38b-eca6ca350109", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:28:04.646659Z", "time_start": "2023-11-07T16:58:04.646659Z", "version": "1f5b5n8l3bgko"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.763651Z"}], "end_time": "2023-11-07T16:58:04.763673Z"}], "successful": true, "end_time": "2023-11-07T16:58:04.763690Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_validation.md#cleanup", "start_time": "2023-11-07T16:58:04.763721Z", "failed_checks": [], "passed_checks": [{"name": "Successful subscription search query", "timestamp": "2023-11-07T16:58:04.767514Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:58:04.763818Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "21"}, "elapsed_s": 0.002278, "reported": "2023-11-07T16:58:04.766872Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.767673Z"}}}, {"test_scenario": {"name": "ASTM NetRID DSS: Subscription Simple", "scenario_type": "scenarios.astm.netrid.v19.dss.SubscriptionSimple", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md", "start_time": "2023-11-07T16:58:04.768365Z", "cases": [{"name": "Setup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#setup-test-case", "start_time": "2023-11-07T16:58:04.768699Z", "steps": [{"name": "Ensure clean workspace", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#ensure-clean-workspace-test-step", "start_time": "2023-11-07T16:58:04.768766Z", "failed_checks": [], "passed_checks": [{"name": "Search for all subscriptions in ISA area", "timestamp": "2023-11-07T16:58:04.772260Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T16:58:04.775241Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T16:58:04.777763Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T16:58:04.780280Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T16:58:04.782810Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:58:04.768860Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "21"}, "elapsed_s": 0.002156, "reported": "2023-11-07T16:58:04.771718Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.772463Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "115"}, "elapsed_s": 0.001578, "reported": "2023-11-07T16:58:04.774737Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350000 not found (E:98052bc7-41d0-49a9-8977-e1c01f55985d)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350001", "initiated_at": "2023-11-07T16:58:04.775345Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "115"}, "elapsed_s": 0.001376, "reported": "2023-11-07T16:58:04.777376Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350001 not found (E:4d56a444-78d6-417a-8881-2926ea13e5bd)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350002", "initiated_at": "2023-11-07T16:58:04.777864Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "115"}, "elapsed_s": 0.001341, "reported": "2023-11-07T16:58:04.779874Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350002 not found (E:4842eeb5-451c-4183-ade3-64069ef2efa9)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T16:58:04.780393Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "115"}, "elapsed_s": 0.001396, "reported": "2023-11-07T16:58:04.782443Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350003 not found (E:65e45543-0ebf-4251-b831-a308da834a42)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.782886Z"}], "end_time": "2023-11-07T16:58:04.782909Z"}, {"name": "Subscription Simple", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#subscription-simple-test-case", "start_time": "2023-11-07T16:58:04.782940Z", "steps": [{"name": "Create subscription validation", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#create-subscription-validation-test-step", "start_time": "2023-11-07T16:58:04.782976Z", "failed_checks": [], "passed_checks": [{"name": "Create subscription", "timestamp": "2023-11-07T16:58:04.794243Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Response to subscription creation contains a subscription", "timestamp": "2023-11-07T16:58:04.796219Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T16:58:04.797344Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T16:58:04.797442Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T16:58:04.797526Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T16:58:04.797657Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T16:58:04.797727Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T16:58:04.797789Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T16:58:04.797847Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T16:58:04.797904Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T16:58:04.797964Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T16:58:04.798022Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T16:58:04.798080Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T16:58:04.798310Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned notification index is 0 if present", "timestamp": "2023-11-07T16:58:04.799405Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T16:58:04.784091Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "518", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}, {"lat": 37.1853, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:48.430930Z", "time_end": "2023-11-07T17:07:48.430930Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "744bda86-664e-4446-b7a8-a9d8d3edd9d0"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "369"}, "elapsed_s": 0.007758, "reported": "2023-11-07T16:58:04.792663Z", "json": {"service_areas": [], "subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:07:48.43093Z", "time_start": "2023-11-07T16:57:48.43093Z", "version": "1f5b5n8p5npb0"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.800378Z"}, {"name": "Mutate Subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#mutate-subscription-test-step", "start_time": "2023-11-07T16:58:04.800784Z", "failed_checks": [], "passed_checks": [{"name": "Subscription can be mutated", "timestamp": "2023-11-07T16:58:04.814211Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Response to subscription mutation contains a subscription", "timestamp": "2023-11-07T16:58:04.815083Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T16:58:04.815906Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T16:58:04.815973Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T16:58:04.816031Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T16:58:04.816089Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T16:58:04.816146Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T16:58:04.816206Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T16:58:04.816262Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T16:58:04.816316Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T16:58:04.816389Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T16:58:04.816448Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T16:58:04.816506Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T16:58:04.816566Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Mutated subscription version is updated", "timestamp": "2023-11-07T16:58:04.816631Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Subscription can be mutated", "timestamp": "2023-11-07T16:58:04.827065Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Response to subscription mutation contains a subscription", "timestamp": "2023-11-07T16:58:04.827947Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T16:58:04.828836Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T16:58:04.828905Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T16:58:04.828964Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T16:58:04.829020Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T16:58:04.829077Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T16:58:04.829137Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T16:58:04.829191Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T16:58:04.829245Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T16:58:04.829301Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T16:58:04.829358Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T16:58:04.829415Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T16:58:04.829475Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Mutated subscription version is updated", "timestamp": "2023-11-07T16:58:04.829539Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}], "queries": [{"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/1f5b5n8p5npb0", "initiated_at": "2023-11-07T16:58:04.801650Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "484", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.614}, {"lat": 37.2148, "lng": -80.614}, {"lat": 37.2148, "lng": -80.544}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:58.430930Z", "time_end": "2023-11-07T17:07:58.430930Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "3ddfa459-c0b1-4b78-bd2a-c22833ff3ec4"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "369"}, "elapsed_s": 0.010656, "reported": "2023-11-07T16:58:04.813215Z", "json": {"service_areas": [], "subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:07:58.43093Z", "time_start": "2023-11-07T16:57:58.43093Z", "version": "1f5b5n8pmnfp0"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "PUT", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/1f5b5n8pmnfp0", "initiated_at": "2023-11-07T16:58:04.818087Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "506", "Content-Type": "application/json", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "json": {"extents": {"spatial_volume": {"footprint": {"vertices": [{"lat": 37.1853, "lng": -80.61500000000001}, {"lat": 37.2148, "lng": -80.61500000000001}, {"lat": 37.2148, "lng": -80.545}]}, "altitude_lo": 0.0, "altitude_hi": 3048.0}, "time_start": "2023-11-07T16:57:58.430930Z", "time_end": "2023-11-07T17:07:58.430930Z"}, "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "request_id": "5c69c97d-7348-48da-9ac1-eb223682c423"}, "body": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "369"}, "elapsed_s": 0.006662, "reported": "2023-11-07T16:58:04.825579Z", "json": {"service_areas": [], "subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:07:58.43093Z", "time_start": "2023-11-07T16:57:58.43093Z", "version": "1f5b5n8q683c8"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.830329Z"}, {"name": "Query Existing Subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#query-existing-subscription-test-step", "start_time": "2023-11-07T16:58:04.830365Z", "failed_checks": [], "passed_checks": [{"name": "Get Subscription by ID", "timestamp": "2023-11-07T16:58:04.835487Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T16:58:04.836302Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T16:58:04.836398Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T16:58:04.836460Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T16:58:04.836519Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T16:58:04.836579Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T16:58:04.836641Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T16:58:04.836698Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T16:58:04.836755Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T16:58:04.836813Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T16:58:04.836872Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T16:58:04.836930Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T16:58:04.836991Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Non-mutated subscription keeps the same version", "timestamp": "2023-11-07T16:58:04.837065Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned notification index is equal to or greater than 0", "timestamp": "2023-11-07T16:58:04.837128Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Search for all subscriptions in ISA area", "timestamp": "2023-11-07T16:58:04.841702Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Created Subscription is in search results", "timestamp": "2023-11-07T16:58:04.842614Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T16:58:04.843433Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T16:58:04.843503Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T16:58:04.843562Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T16:58:04.843620Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T16:58:04.843678Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T16:58:04.843739Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T16:58:04.843796Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T16:58:04.843852Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T16:58:04.843910Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T16:58:04.843968Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T16:58:04.844026Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T16:58:04.844087Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Non-mutated subscription keeps the same version", "timestamp": "2023-11-07T16:58:04.844160Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned notification index is equal to or greater than 0", "timestamp": "2023-11-07T16:58:04.844223Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "No huge search area allowed", "timestamp": "2023-11-07T16:58:04.846629Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T16:58:04.830623Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "350"}, "elapsed_s": 0.001704, "reported": "2023-11-07T16:58:04.833432Z", "json": {"subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:07:58.43093Z", "time_start": "2023-11-07T16:57:58.43093Z", "version": "1f5b5n8q683c8"}}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:58:04.837389Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "353"}, "elapsed_s": 0.002362, "reported": "2023-11-07T16:58:04.840738Z", "json": {"subscriptions": [{"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:07:58.43093Z", "time_start": "2023-11-07T16:57:58.43093Z", "version": "1f5b5n8q683c8"}]}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=38.0,-81.0,37.0,-81.0,37.0,-80.0,38.0,-80.0", "initiated_at": "2023-11-07T16:58:04.844310Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 413, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "70"}, "elapsed_s": 0.0011, "reported": "2023-11-07T16:58:04.846249Z", "json": {"message": "Area too large (E:02a19059-32cd-4876-9818-17b3caae594c)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.846676Z"}, {"name": "Delete Subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#delete-subscription-test-step", "start_time": "2023-11-07T16:58:04.846708Z", "failed_checks": [], "passed_checks": [{"name": "Missing version prevents deletion", "timestamp": "2023-11-07T16:58:04.849150Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Incorrect version prevents deletion", "timestamp": "2023-11-07T16:58:04.851114Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Subscription can be deleted", "timestamp": "2023-11-07T16:58:04.860924Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,d"]}, {"name": "Returned subscription has an ID", "timestamp": "2023-11-07T16:58:04.861765Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription ID is correct", "timestamp": "2023-11-07T16:58:04.861832Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an owner", "timestamp": "2023-11-07T16:58:04.861889Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription owner is correct", "timestamp": "2023-11-07T16:58:04.861943Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an ISA URL", "timestamp": "2023-11-07T16:58:04.861997Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned ISA URL has correct base URL", "timestamp": "2023-11-07T16:58:04.862054Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a start time", "timestamp": "2023-11-07T16:58:04.862108Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has an end time", "timestamp": "2023-11-07T16:58:04.862161Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0060"]}, {"name": "Returned start time is correct", "timestamp": "2023-11-07T16:58:04.862216Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned end time is correct", "timestamp": "2023-11-07T16:58:04.862271Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned subscription has a version", "timestamp": "2023-11-07T16:58:04.862325Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Generated subscription version has proper format", "timestamp": "2023-11-07T16:58:04.862382Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Non-mutated subscription keeps the same version", "timestamp": "2023-11-07T16:58:04.862452Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,c"]}, {"name": "Returned notification index is equal to or greater than 0", "timestamp": "2023-11-07T16:58:04.862511Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}], "queries": [{"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/", "initiated_at": "2023-11-07T16:58:04.847053Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "78"}, "elapsed_s": 0.001086, "reported": "2023-11-07T16:58:04.848802Z", "json": {"message": "Missing version string (E:214e696e-a515-4d8d-830d-3647d03f2c93)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/notacorrectversion", "initiated_at": "2023-11-07T16:58:04.849236Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "125"}, "elapsed_s": 0.000985, "reported": "2023-11-07T16:58:04.850849Z", "json": {"message": "strconv.ParseUint: parsing \"notacorrectversion\": value out of range (E:b419ee86-9702-4106-a124-a8147bf61558)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "DELETE", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003/1f5b5n8q683c8", "initiated_at": "2023-11-07T16:58:04.851870Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Content-Length": "0", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "350"}, "elapsed_s": 0.005775, "reported": "2023-11-07T16:58:04.858699Z", "json": {"subscription": {"id": "00000173-e36d-40be-d38b-eca6ca350003", "callbacks": {"identification_service_area_url": "https://uss_qualifier.test.utm/dummy_base_url/v1/uss/identification_service_areas"}, "owner": "uss_qualifier", "notification_index": 0, "time_end": "2023-11-07T17:07:58.43093Z", "time_start": "2023-11-07T16:57:58.43093Z", "version": "1f5b5n8q683c8"}}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.862536Z"}, {"name": "Query Deleted Subscription", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#query-deleted-subscription-test-step", "start_time": "2023-11-07T16:58:04.862566Z", "failed_checks": [], "passed_checks": [{"name": "Query by subscription ID should fail", "timestamp": "2023-11-07T16:58:04.866374Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Search for all subscriptions in ISA area", "timestamp": "2023-11-07T16:58:04.871229Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Deleted subscription should not be present in search results", "timestamp": "2023-11-07T16:58:04.871435Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}, {"name": "Search area that represents a loop is not allowed", "timestamp": "2023-11-07T16:58:04.873599Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,f"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T16:58:04.862763Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "115"}, "elapsed_s": 0.002289, "reported": "2023-11-07T16:58:04.866099Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350003 not found (E:2cab73f9-bbc5-4ab6-ac3a-9ba204d3e29d)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544", "initiated_at": "2023-11-07T16:58:04.867089Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "21"}, "elapsed_s": 0.002238, "reported": "2023-11-07T16:58:04.870266Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=37.1853,-80.614,37.2148,-80.614,37.2148,-80.544,37.1853,-80.544,37.1853,-80.614", "initiated_at": "2023-11-07T16:58:04.871525Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 400, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "103"}, "elapsed_s": 0.001116, "reported": "2023-11-07T16:58:04.873324Z", "json": {"message": "Intersection found between polygon edge 1 and 4 (E:cdb9f25d-a663-43f1-963f-65d46a4ebd7d)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.873676Z"}], "end_time": "2023-11-07T16:58:04.874151Z"}], "successful": true, "end_time": "2023-11-07T16:58:04.874178Z", "cleanup": {"name": "Cleanup", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/subscription_simple.md#cleanup", "start_time": "2023-11-07T16:58:04.874209Z", "failed_checks": [], "passed_checks": [{"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T16:58:04.876694Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T16:58:04.879605Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T16:58:04.882052Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}, {"name": "Subscription can be queried by ID", "timestamp": "2023-11-07T16:58:04.884500Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0030,e"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350000", "initiated_at": "2023-11-07T16:58:04.874269Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "115"}, "elapsed_s": 0.001522, "reported": "2023-11-07T16:58:04.876442Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350000 not found (E:583f93cc-8dca-47ef-b281-7e6bf72e7eef)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350001", "initiated_at": "2023-11-07T16:58:04.877221Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "115"}, "elapsed_s": 0.001459, "reported": "2023-11-07T16:58:04.879321Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350001 not found (E:d46cfb5a-89a1-4a97-ada3-7710ddcbeb7a)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350002", "initiated_at": "2023-11-07T16:58:04.879754Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "115"}, "elapsed_s": 0.001388, "reported": "2023-11-07T16:58:04.881787Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350002 not found (E:0c8cb453-28ce-4096-b6ba-97b5bf1283d0)"}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions/00000173-e36d-40be-d38b-eca6ca350003", "initiated_at": "2023-11-07T16:58:04.882151Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 404, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "115"}, "elapsed_s": 0.00145, "reported": "2023-11-07T16:58:04.884199Z", "json": {"message": "Subscription 00000173-e36d-40be-d38b-eca6ca350003 not found (E:f9aa7fbd-c2ce-473f-af63-d54e809a58d1)"}, "body": null}, "participant_id": "uss1"}], "end_time": "2023-11-07T16:58:04.884578Z"}}}, {"test_scenario": {"name": "ASTM F3411-19 NetRID DSS interoperability", "scenario_type": "scenarios.astm.netrid.v19.DSSInteroperability", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss_interoperability.md", "start_time": "2023-11-07T16:58:04.885002Z", "cases": [{"name": "Prerequisites", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss_interoperability.md#prerequisites-test-case", "start_time": "2023-11-07T16:58:04.885076Z", "steps": [{"name": "Test environment requirements", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss_interoperability.md#test-environment-requirements-test-step", "start_time": "2023-11-07T16:58:04.885113Z", "failed_checks": [], "passed_checks": [{"name": "DSS instance is publicly addressable", "timestamp": "2023-11-07T16:58:04.885664Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0210"]}, {"name": "DSS instance is reachable", "timestamp": "2023-11-07T16:58:04.888759Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0210"]}, {"name": "DSS instance is publicly addressable", "timestamp": "2023-11-07T16:58:04.889264Z", "participants": ["uss2"], "requirements": ["astm.f3411.v19.DSS0210"]}, {"name": "DSS instance is reachable", "timestamp": "2023-11-07T16:58:04.895592Z", "participants": ["uss2"], "requirements": ["astm.f3411.v19.DSS0210"]}], "queries": [{"request": {"method": "GET", "url": "http://dss.uss1.localutm/v1/dss/subscriptions?area=-23.6558,130.6205,-23.6898,130.6301,-23.6709,130.67,-23.6407,130.6466", "initiated_at": "2023-11-07T16:58:04.885781Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMS5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg3OCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "21"}, "elapsed_s": 0.001903, "reported": "2023-11-07T16:58:04.888322Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss1"}, {"request": {"method": "GET", "url": "http://dss.uss2.localutm/v1/dss/subscriptions?area=-23.6558,130.6205,-23.6898,130.6301,-23.6709,130.67,-23.6407,130.6466", "initiated_at": "2023-11-07T16:58:04.889385Z", "headers": {"User-Agent": "python-requests/2.25.1", "Accept-Encoding": "gzip, deflate", "Accept": "*/*", "Connection": "keep-alive", "Authorization": "Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJkc3MudXNzMi5sb2NhbHV0bSIsImV4cCI6MTY5OTM3OTg4NCwiaXNzIjoiZHVtbXkiLCJzY29wZSI6ImRzcy5yZWFkLmlkZW50aWZpY2F0aW9uX3NlcnZpY2VfYXJlYXMiLCJzdWIiOiJ1c3NfcXVhbGlmaWVyIn0.REDACTED"}, "body": null, "json": null}, "response": {"code": 200, "headers": {"Content-Type": "application/json; charset=utf-8", "Date": "Tue, 07 Nov 2023 16:58:04 GMT", "Content-Length": "21"}, "elapsed_s": 0.002663, "reported": "2023-11-07T16:58:04.894587Z", "json": {"subscriptions": []}, "body": null}, "participant_id": "uss2"}], "end_time": "2023-11-07T16:58:04.895644Z"}], "end_time": "2023-11-07T16:58:04.895665Z"}, {"name": "Interoperability sequence", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss_interoperability.md#interoperability-sequence-test-case", "start_time": "2023-11-07T16:58:04.895697Z", "steps": [{"name": "S1", "documentation_url": "https://github.com/interuss/monitoring/blob/197381398d21bc12b7ff83a214ebd548b1048a8c/monitoring/uss_qualifier/scenarios/astm/netrid/v19/dss/test_steps/put_isa.md#create-or-update-isa-test-step", "start_time": "2023-11-07T16:58:04.895751Z", "failed_checks": [], "passed_checks": [{"name": "ISA[P] created with proper response", "timestamp": "2023-11-07T16:58:04.895840Z", "participants": ["uss1"], "requirements": ["astm.f3411.v19.DSS0130,A2-6-1,1a"]}]}]}], "successful": false, "notes": {"uss1_private_address": {"message": "DSS instance (URL: http://dss.uss1.localutm, netloc: dss.uss1.localutm, resolved IP: 172.19.0.3) is declared as explicitly having a private address, skipping check", "timestamp": "2023-11-07T16:58:04.885457Z"}, "uss2_private_address": {"message": "DSS instance (URL: http://dss.uss2.localutm, netloc: dss.uss2.localutm, resolved IP: 172.19.0.3) is declared as explicitly having a private address, skipping check", "timestamp": "2023-11-07T16:58:04.889074Z"}}, "execution_error": {"type": "TypeError", "message": "'ExecutionContext' object does not support item assignment", "timestamp": "2023-11-07T16:58:04.895877Z", "stacktrace": "Traceback (most recent call last):\n File \"/app/monitoring/uss_qualifier/suites/suite.py\", line 150, in _run_test_scenario\n scenario.run(context)\n File \"/app/monitoring/uss_qualifier/scenarios/astm/netrid/common/dss_interoperability.py\", line 109, in run\n step()\n File \"/app/monitoring/uss_qualifier/scenarios/astm/netrid/common/dss_interoperability.py\", line 147, in step1\n isa_1 = self._new_isa(\"isa_1\")\n File \"/app/monitoring/uss_qualifier/scenarios/astm/netrid/common/dss_interoperability.py\", line 78, in _new_isa\n self._context[name] = TestEntity(EntityType.ISA, str(uuid.uuid4()))\nTypeError: 'ExecutionContext' object does not support item assignment\n"}}}], "capability_evaluations": [], "successful": false, "end_time": "2023-11-07T16:58:04.898180Z"}}], "generator_type": "action_generators.astm.f3411.ForEachDSS", "start_time": "2023-11-07T16:57:58.877698Z", "successful": false, "end_time": "2023-11-07T16:58:04.899024Z"}}], "capability_evaluations": [], "successful": false, "end_time": "2023-11-07T16:58:04.899331Z"}}} \ No newline at end of file diff --git a/artifacts/uss_qualifier/reports/dss_probing/requirements/status.json b/artifacts/uss_qualifier/reports/dss_probing/requirements/status.json index 6628938ffa..0927415ec8 100644 --- a/artifacts/uss_qualifier/reports/dss_probing/requirements/status.json +++ b/artifacts/uss_qualifier/reports/dss_probing/requirements/status.json @@ -1,9 +1,9 @@ { "test_run_information": { - "test_run_id": "6545c0191f1e72a4b485bbc327467162e8c2494001e73021d559753ef01f0629", - "start_time": "2023-11-07 15:06:41 UTC", - "end_time": "2023-11-07 15:06:47 UTC", - "baseline": "21813fb08140f0d2883d6350a8c3f29e32a72b68cecc49e9078a2eaa93e211bd", + "test_run_id": "406e48774c824c0c71d29507ddc97a8d48d0afb379b31ec0b3449eb41553cbf1", + "start_time": "2023-11-07 16:57:58 UTC", + "end_time": "2023-11-07 16:58:04 UTC", + "baseline": "76b192786744f7eff4581e391eb56d8a679b139020adf0c861477a5a01a49167", "environment": "383670842b90e623e04660bab8132198849a61457e0d90caf9eebb0df6322efb" }, "participant_verifications": { diff --git a/artifacts/uss_qualifier/reports/dss_probing/requirements/uss1.html b/artifacts/uss_qualifier/reports/dss_probing/requirements/uss1.html index dd9bb0f73c..9074db8f34 100644 --- a/artifacts/uss_qualifier/reports/dss_probing/requirements/uss1.html +++ b/artifacts/uss_qualifier/reports/dss_probing/requirements/uss1.html @@ -86,19 +86,19 @@

Test run

Test run identifier - TR-6545c01 + TR-406e487 Start time - 2023-11-07 15:06:41 UTC + 2023-11-07 16:57:58 UTC End time - 2023-11-07 15:06:47 UTC + 2023-11-07 16:58:04 UTC Test baseline identifier - TB-21813fb + TB-76b1927 Environment identifier @@ -126,7 +126,7 @@

Tested requirements

- astm
.f3411
.v19
+ astm
.f3411
.v19
DSS0010 Not tested Not implemented @@ -142,401 +142,401 @@

Tested requirements

DSS0030,a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S1 + S1 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S5 + S5 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S10 + S10 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S12 + S12 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Pass - ASTM NetRID DSS: ISA Expiry + ASTM NetRID DSS: ISA Expiry - ISA Expiry + ISA Expiry - ISA Expiry + ISA Expiry - Create short-lived ISA + Create short-lived ISA Pass - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Create an ISA + Create an ISA Pass - Mutate the ISA + Mutate the ISA Pass - Response to the mutation of the ISA contains subscription ID + Response to the mutation of the ISA contains subscription ID Pass - Subscription to an ISA has its notification index incremented after mutation + Subscription to an ISA has its notification index incremented after mutation Pass - Subscription to an ISA has its notification index incremented after deletion + Subscription to an ISA has its notification index incremented after deletion Pass - ASTM NetRID DSS: Simple ISA + ASTM NetRID DSS: Simple ISA - Create and check ISA + Create and check ISA - Create ISA + Create ISA - ISA response code + ISA response code Pass - ISA response format + ISA response format Pass - ISA ID matches + ISA ID matches Pass - ISA start time matches + ISA start time matches Pass - ISA end time matches + ISA end time matches Pass - ISA URL matches + ISA URL matches Pass - ISA created + ISA created Not tested - ISA version changed + ISA version changed Pass - Update and search ISA + Update and search ISA - Update ISA + Update ISA - ISA response code + ISA response code Pass - ISA response format + ISA response format Pass - ISA ID matches + ISA ID matches Pass - ISA version changed + ISA version changed Pass - ISA start time matches + ISA start time matches Pass - ISA end time matches + ISA end time matches Pass - ISA URL matches + ISA URL matches Pass - ISA updated + ISA updated @@ -544,172 +544,172 @@

Tested requirements

DSS0030,b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S11 + S11 - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - S15 + S15 - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - ASTM NetRID DSS: ISA Expiry + ASTM NetRID DSS: ISA Expiry - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Pass - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Response to the deletion of the ISA contains subscription ID + Response to the deletion of the ISA contains subscription ID Pass - ASTM NetRID DSS: Simple ISA + ASTM NetRID DSS: Simple ISA - Delete ISA + Delete ISA - Delete with wrong version + Delete with wrong version - Delete request rejected + Delete request rejected Pass - Delete with empty version + Delete with empty version - Delete request rejected + Delete request rejected Pass - Delete ISA + Delete ISA - ISA response format + ISA response format Pass - ISA ID matches + ISA ID matches Pass - ISA version matches + ISA version matches Pass - ISA deleted + ISA deleted Not tested - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - ASTM NetRID DSS: Submitted ISA Validations + ASTM NetRID DSS: Submitted ISA Validations - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA @@ -717,147 +717,147 @@

Tested requirements

DSS0030,c Pass - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Create a subscription within the ISA footprint + Create a subscription within the ISA footprint Pass - Subscription for the ISA's area mentions the ISA + Subscription for the ISA's area mentions the ISA Pass - Newly created subscription has a notification_index of 0 + Newly created subscription has a notification_index of 0 Pass - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Create subscription validation + Create subscription validation - Create subscription + Create subscription Pass - Response to subscription creation contains a subscription + Response to subscription creation contains a subscription Pass - Returned subscription has an ID + Returned subscription has an ID Pass - Returned subscription ID is correct + Returned subscription ID is correct Pass - Returned subscription has an owner + Returned subscription has an owner Pass - Returned subscription owner is correct + Returned subscription owner is correct Pass - Returned subscription has an ISA URL + Returned subscription has an ISA URL Pass - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Pass - Returned subscription has a start time + Returned subscription has a start time Pass - Returned start time is correct + Returned start time is correct Pass - Returned end time is correct + Returned end time is correct Pass - Returned subscription has a version + Returned subscription has a version Pass - Generated subscription version has proper format + Generated subscription version has proper format Pass - Returned notification index is 0 if present + Returned notification index is 0 if present Pass - Mutate Subscription + Mutate Subscription - Subscription can be mutated + Subscription can be mutated (2x) @@ -865,7 +865,7 @@

Tested requirements

Pass - Response to subscription mutation contains a subscription + Response to subscription mutation contains a subscription (2x) @@ -873,7 +873,7 @@

Tested requirements

Pass - Returned subscription has an ID + Returned subscription has an ID (2x) @@ -881,7 +881,7 @@

Tested requirements

Pass - Returned subscription ID is correct + Returned subscription ID is correct (2x) @@ -889,7 +889,7 @@

Tested requirements

Pass - Returned subscription has an owner + Returned subscription has an owner (2x) @@ -897,7 +897,7 @@

Tested requirements

Pass - Returned subscription owner is correct + Returned subscription owner is correct (2x) @@ -905,7 +905,7 @@

Tested requirements

Pass - Returned subscription has an ISA URL + Returned subscription has an ISA URL (2x) @@ -913,7 +913,7 @@

Tested requirements

Pass - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL (2x) @@ -921,7 +921,7 @@

Tested requirements

Pass - Returned subscription has a start time + Returned subscription has a start time (2x) @@ -929,7 +929,7 @@

Tested requirements

Pass - Returned start time is correct + Returned start time is correct (2x) @@ -937,7 +937,7 @@

Tested requirements

Pass - Returned end time is correct + Returned end time is correct (2x) @@ -945,7 +945,7 @@

Tested requirements

Pass - Returned subscription has a version + Returned subscription has a version (2x) @@ -953,7 +953,7 @@

Tested requirements

Pass - Generated subscription version has proper format + Generated subscription version has proper format (2x) @@ -961,7 +961,7 @@

Tested requirements

Pass - Mutated subscription version is updated + Mutated subscription version is updated (2x) @@ -969,10 +969,10 @@

Tested requirements

Pass - Query Existing Subscription + Query Existing Subscription - Returned subscription has an ID + Returned subscription has an ID (2x) @@ -980,7 +980,7 @@

Tested requirements

Pass - Returned subscription ID is correct + Returned subscription ID is correct (2x) @@ -988,7 +988,7 @@

Tested requirements

Pass - Returned subscription has an owner + Returned subscription has an owner (2x) @@ -996,7 +996,7 @@

Tested requirements

Pass - Returned subscription owner is correct + Returned subscription owner is correct (2x) @@ -1004,7 +1004,7 @@

Tested requirements

Pass - Returned subscription has an ISA URL + Returned subscription has an ISA URL (2x) @@ -1012,7 +1012,7 @@

Tested requirements

Pass - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL (2x) @@ -1020,7 +1020,7 @@

Tested requirements

Pass - Returned subscription has a start time + Returned subscription has a start time (2x) @@ -1028,7 +1028,7 @@

Tested requirements

Pass - Returned start time is correct + Returned start time is correct (2x) @@ -1036,7 +1036,7 @@

Tested requirements

Pass - Returned end time is correct + Returned end time is correct (2x) @@ -1044,7 +1044,7 @@

Tested requirements

Pass - Returned subscription has a version + Returned subscription has a version (2x) @@ -1052,7 +1052,7 @@

Tested requirements

Pass - Generated subscription version has proper format + Generated subscription version has proper format (2x) @@ -1060,7 +1060,7 @@

Tested requirements

Pass - Non-mutated subscription keeps the same version + Non-mutated subscription keeps the same version (2x) @@ -1068,116 +1068,116 @@

Tested requirements

Pass - Delete Subscription + Delete Subscription - Returned subscription has an ID + Returned subscription has an ID Pass - Returned subscription ID is correct + Returned subscription ID is correct Pass - Returned subscription has an owner + Returned subscription has an owner Pass - Returned subscription owner is correct + Returned subscription owner is correct Pass - Returned subscription has an ISA URL + Returned subscription has an ISA URL Pass - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Pass - Returned subscription has a start time + Returned subscription has a start time Pass - Returned start time is correct + Returned start time is correct Pass - Returned end time is correct + Returned end time is correct Pass - Returned subscription has a version + Returned subscription has a version Pass - Generated subscription version has proper format + Generated subscription version has proper format Pass - Non-mutated subscription keeps the same version + Non-mutated subscription keeps the same version Pass - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription duration limitations + Subscription duration limitations - Try to extend subscription + Try to extend subscription - Valid subscription created + Valid subscription created Pass - Subscription quantity limitations + Subscription quantity limitations - Create maximum number of subscriptions + Create maximum number of subscriptions - Create up to the maximum allowed number of subscriptions in an area + Create up to the maximum allowed number of subscriptions in an area @@ -1185,115 +1185,115 @@

Tested requirements

DSS0030,d Pass - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Delete the ISA + Delete the ISA Pass - Successful subscription deletion + Successful subscription deletion Not tested - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - Successful subscription deletion + Successful subscription deletion Pass - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Delete Subscription + Delete Subscription - Missing version prevents deletion + Missing version prevents deletion Pass - Incorrect version prevents deletion + Incorrect version prevents deletion Pass - Subscription can be deleted + Subscription can be deleted Not tested - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be deleted + Subscription can be deleted Pass - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription duration limitations + Subscription duration limitations - Remove subscription + Remove subscription - Subscription deleted + Subscription deleted Pass - Subscription quantity limitations + Subscription quantity limitations - Clean up subscriptions + Clean up subscriptions - Subscription can be deleted + Subscription can be deleted (10x) @@ -1301,13 +1301,13 @@

Tested requirements

Not tested - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be deleted + Subscription can be deleted @@ -1315,16 +1315,16 @@

Tested requirements

DSS0030,e Pass - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be queried by ID + Subscription can be queried by ID (4x) @@ -1332,20 +1332,20 @@

Tested requirements

Pass - Subscription Simple + Subscription Simple - Query Existing Subscription + Query Existing Subscription - Get Subscription by ID + Get Subscription by ID Pass - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 (2x) @@ -1353,46 +1353,46 @@

Tested requirements

Pass - Delete Subscription + Delete Subscription - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Pass - Query Deleted Subscription + Query Deleted Subscription - Query by subscription ID should fail + Query by subscription ID should fail Not tested - Mutate Subscription + Mutate Subscription - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be queried by ID + Subscription can be queried by ID @@ -1400,112 +1400,112 @@

Tested requirements

DSS0030,f Pass - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Successful subscription search query + Successful subscription search query Pass - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Pass - Subscription Simple + Subscription Simple - Query Existing Subscription + Query Existing Subscription - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Pass - Created Subscription is in search results + Created Subscription is in search results Pass - No huge search area allowed + No huge search area allowed Pass - Query Deleted Subscription + Query Deleted Subscription - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Pass - Deleted subscription should not be present in search results + Deleted subscription should not be present in search results Pass - Search area that represents a loop is not allowed + Search area that represents a loop is not allowed Pass - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Successful subscription search query + Successful subscription search query Pass - Subscription quantity limitations + Subscription quantity limitations - Clean up subscriptions + Clean up subscriptions - Successful subscription search query + Successful subscription search query @@ -1519,16 +1519,16 @@

Tested requirements

DSS0050 Pass - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription quantity limitations + Subscription quantity limitations - Exceed maximum number of subscriptions + Exceed maximum number of subscriptions - Enforce maximum number of subscriptions for an area + Enforce maximum number of subscriptions for an area @@ -1536,26 +1536,26 @@

Tested requirements

DSS0060 Pass - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Create subscription validation + Create subscription validation - Returned subscription has an end time + Returned subscription has an end time Pass - Mutate Subscription + Mutate Subscription - Returned subscription has an end time + Returned subscription has an end time (2x) @@ -1563,10 +1563,10 @@

Tested requirements

Pass - Query Existing Subscription + Query Existing Subscription - Returned subscription has an end time + Returned subscription has an end time (2x) @@ -1574,36 +1574,36 @@

Tested requirements

Pass - Delete Subscription + Delete Subscription - Returned subscription has an end time + Returned subscription has an end time Pass - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription duration limitations + Subscription duration limitations - Try to create too-long subscription + Try to create too-long subscription - Too-long subscription creation rejected + Too-long subscription creation rejected Pass - Try to extend subscription + Try to extend subscription - Subscription duration limited during update + Subscription duration limited during update @@ -1611,76 +1611,76 @@

Tested requirements

DSS0070 Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] returned with proper response + Subscription[P] returned with proper response Not tested - S4 + S4 - Can query all Subscriptions in area from all DSSs + Can query all Subscriptions in area from all DSSs Not tested - S7 + S7 - 404 with proper response + 404 with proper response Not tested - S8 + S8 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S9 + S9 - service_areas does not include ISA from S1 + service_areas does not include ISA from S1 Not tested - S13 + S13 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S16 + S16 - service_areas does not include ISA from S12 + service_areas does not include ISA from S12 @@ -1688,16 +1688,16 @@

Tested requirements

DSS0110 Not tested - ASTM NetRID DSS: Direct CRDB access + ASTM NetRID DSS: Direct CRDB access - Verify security interoperability + Verify security interoperability - Attempt unauthorized access + Attempt unauthorized access - CRDB node in insecure mode + CRDB node in insecure mode @@ -1705,16 +1705,16 @@

Tested requirements

DSS0120 Not tested - ASTM NetRID DSS: Direct CRDB access + ASTM NetRID DSS: Direct CRDB access - Verify security interoperability + Verify security interoperability - Verify encryption + Verify encryption - TLS in use + TLS in use @@ -1728,16 +1728,16 @@

Tested requirements

DSS0130,2,a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] ID is properly synchronized with all DSS + Subscription[P] ID is properly synchronized with all DSS @@ -1745,16 +1745,16 @@

Tested requirements

DSS0130,2,b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] owner is properly synchronized with all DSS + Subscription[P] owner is properly synchronized with all DSS @@ -1762,16 +1762,16 @@

Tested requirements

DSS0130,2,c Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] URL is properly synchronized with all DSS + Subscription[P] URL is properly synchronized with all DSS @@ -1779,16 +1779,16 @@

Tested requirements

DSS0130,2,d Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] start/end times are properly synchronized with all DSS + Subscription[P] start/end times are properly synchronized with all DSS @@ -1802,16 +1802,16 @@

Tested requirements

DSS0130,2,f Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] notification count is properly synchronized with all DSS + Subscription[P] notification count is properly synchronized with all DSS @@ -1819,26 +1819,26 @@

Tested requirements

DSS0130,3,a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - ID of ISA from S1 is properly synchronized with all DSS + ID of ISA from S1 is properly synchronized with all DSS Not tested - S5 + S5 - Can get ISA from primary DSS + Can get ISA from primary DSS @@ -1846,16 +1846,16 @@

Tested requirements

DSS0130,3,b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Owner of ISA from S1 is properly synchronized with all DSS + Owner of ISA from S1 is properly synchronized with all DSS @@ -1863,16 +1863,16 @@

Tested requirements

DSS0130,3,c Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - URL of ISA from S1 is properly synchronized with all DSS + URL of ISA from S1 is properly synchronized with all DSS @@ -1880,16 +1880,16 @@

Tested requirements

DSS0130,3,d Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Start/end times of ISA from S1 are properly synchronized with all DSS + Start/end times of ISA from S1 are properly synchronized with all DSS @@ -1897,16 +1897,16 @@

Tested requirements

DSS0130,3,e Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - service_areas includes ISA from S1 + service_areas includes ISA from S1 @@ -1914,36 +1914,36 @@

Tested requirements

DSS0130,A2-6-1,1a Pass - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S1 + S1 - ISA[P] created with proper response + ISA[P] created with proper response Not tested - S10 + S10 - ISA[P] created with proper response + ISA[P] created with proper response Not tested - S12 + S12 - ISA[P] created with proper response + ISA[P] created with proper response @@ -1951,16 +1951,16 @@

Tested requirements

DSS0130,A2-6-1,1b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S5 + S5 - Can modify ISA in primary DSS + Can modify ISA in primary DSS @@ -1968,26 +1968,26 @@

Tested requirements

DSS0130,A2-6-1,1c Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - service_areas includes ISA from S1 + service_areas includes ISA from S1 Not tested - S9 + S9 - Subscription[n] created with proper response + Subscription[n] created with proper response @@ -1995,16 +1995,16 @@

Tested requirements

DSS0130,A2-6-1,1d Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S9 + S9 - service_areas does not include ISA from S1 + service_areas does not include ISA from S1 @@ -2012,26 +2012,26 @@

Tested requirements

DSS0130,A2-6-1,2a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S11 + S11 - ISA[P] deleted with proper response + ISA[P] deleted with proper response Not tested - S15 + S15 - ISA[P] deleted with proper response + ISA[P] deleted with proper response @@ -2039,16 +2039,16 @@

Tested requirements

DSS0130,A2-6-1,2b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S16 + S16 - service_areas does not include ISA from S12 + service_areas does not include ISA from S12 @@ -2056,26 +2056,26 @@

Tested requirements

DSS0130,A2-6-1,3a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Subscription[n] created with proper response + Subscription[n] created with proper response Not tested - S16 + S16 - Subscription[n] created with proper response + Subscription[n] created with proper response @@ -2083,16 +2083,16 @@

Tested requirements

DSS0130,A2-6-1,3b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S10 + S10 - All Subscription[i] 1≤i≤n returned in subscribers + All Subscription[i] 1≤i≤n returned in subscribers @@ -2100,26 +2100,26 @@

Tested requirements

DSS0130,A2-6-1,3c Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S5 + S5 - ISA modification triggers subscription notification requests + ISA modification triggers subscription notification requests Not tested - S11 + S11 - All Subscription[i] 1≤i≤n returned in subscribers + All Subscription[i] 1≤i≤n returned in subscribers @@ -2127,46 +2127,46 @@

Tested requirements

DSS0130,A2-6-1,3d Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S12 + S12 - None of Subscription[i] 1≤i≤n returned in subscribers + None of Subscription[i] 1≤i≤n returned in subscribers Not tested - S13 + S13 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S14 + S14 - 404 with proper response + 404 with proper response Not tested - S15 + S15 - None of Subscription[i] 1≤i≤n returned in subscribers with proper response + None of Subscription[i] 1≤i≤n returned in subscribers with proper response @@ -2174,26 +2174,26 @@

Tested requirements

DSS0130,A2-6-1,4a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S6 + S6 - Subscription[n] deleted with proper response + Subscription[n] deleted with proper response Not tested - S17 + S17 - Subscription[n] deleted with proper response + Subscription[n] deleted with proper response @@ -2201,26 +2201,26 @@

Tested requirements

DSS0130,A2-6-1,4b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S7 + S7 - 404 with proper response + 404 with proper response Not tested - S8 + S8 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response @@ -2228,16 +2228,16 @@

Tested requirements

DSS0130,A2-6-1,5 Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] returned with proper response + Subscription[P] returned with proper response @@ -2245,36 +2245,36 @@

Tested requirements

DSS0130,A2-6-1,6 Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S4 + S4 - Can query all Subscriptions in area from all DSSs + Can query all Subscriptions in area from all DSSs Not tested - S8 + S8 - Subscriptions queried successfully + Subscriptions queried successfully Not tested - S13 + S13 - Subscriptions queried successfully + Subscriptions queried successfully @@ -2282,28 +2282,28 @@

Tested requirements

DSS0210 Pass - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Prerequisites + Prerequisites - Test environment requirements + Test environment requirements - DSS instance is publicly addressable + DSS instance is publicly addressable Pass - DSS instance is reachable + DSS instance is reachable - astm
.f3411
.v22a
+ astm
.f3411
.v22a
DSS0010 Not tested Not implemented @@ -2319,401 +2319,401 @@

Tested requirements

DSS0030,a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S1 + S1 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S5 + S5 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S10 + S10 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S12 + S12 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - ASTM NetRID DSS: ISA Expiry + ASTM NetRID DSS: ISA Expiry - ISA Expiry + ISA Expiry - ISA Expiry + ISA Expiry - Create short-lived ISA + Create short-lived ISA Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Create an ISA + Create an ISA Not tested - Mutate the ISA + Mutate the ISA Not tested - Response to the mutation of the ISA contains subscription ID + Response to the mutation of the ISA contains subscription ID Not tested - Subscription to an ISA has its notification index incremented after mutation + Subscription to an ISA has its notification index incremented after mutation Not tested - Subscription to an ISA has its notification index incremented after deletion + Subscription to an ISA has its notification index incremented after deletion Not tested - ASTM NetRID DSS: Simple ISA + ASTM NetRID DSS: Simple ISA - Create and check ISA + Create and check ISA - Create ISA + Create ISA - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - ISA created + ISA created Not tested - Update and search ISA + Update and search ISA - Update ISA + Update ISA - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - ISA updated + ISA updated @@ -2721,172 +2721,172 @@

Tested requirements

DSS0030,b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S11 + S11 - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - S15 + S15 - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - ASTM NetRID DSS: ISA Expiry + ASTM NetRID DSS: ISA Expiry - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Response to the deletion of the ISA contains subscription ID + Response to the deletion of the ISA contains subscription ID Not tested - ASTM NetRID DSS: Simple ISA + ASTM NetRID DSS: Simple ISA - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - Delete ISA + Delete ISA - Delete with wrong version + Delete with wrong version - Delete request rejected + Delete request rejected Not tested - Delete with empty version + Delete with empty version - Delete request rejected + Delete request rejected Not tested - Delete ISA + Delete ISA - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - ISA deleted + ISA deleted Not tested - ASTM NetRID DSS: Submitted ISA Validations + ASTM NetRID DSS: Submitted ISA Validations - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA @@ -2894,441 +2894,441 @@

Tested requirements

DSS0030,c Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Create a subscription within the ISA footprint + Create a subscription within the ISA footprint Not tested - Subscription for the ISA's area mentions the ISA + Subscription for the ISA's area mentions the ISA Not tested - Newly created subscription has a notification_index of 0 + Newly created subscription has a notification_index of 0 Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Create subscription validation + Create subscription validation - Create subscription + Create subscription Not tested - Response to subscription creation contains a subscription + Response to subscription creation contains a subscription Not tested - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned notification index is 0 if present + Returned notification index is 0 if present Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - Query Existing Subscription + Query Existing Subscription - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Non-mutated subscription keeps the same version + Non-mutated subscription keeps the same version Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - Mutate Subscription + Mutate Subscription - Subscription can be mutated + Subscription can be mutated Not tested - Response to subscription mutation contains a subscription + Response to subscription mutation contains a subscription Not tested - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Mutated subscription version is updated + Mutated subscription version is updated Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - Delete Subscription + Delete Subscription - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Non-mutated subscription keeps the same version + Non-mutated subscription keeps the same version Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription quantity limitations + Subscription quantity limitations - Create maximum number of subscriptions + Create maximum number of subscriptions - Create up to the maximum allowed number of subscriptions in an area + Create up to the maximum allowed number of subscriptions in an area Not tested - Subscription duration limitations + Subscription duration limitations - Try to extend subscription + Try to extend subscription - Valid subscription created + Valid subscription created @@ -3336,128 +3336,128 @@

Tested requirements

DSS0030,d Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - Successful subscription deletion + Successful subscription deletion Not tested - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Delete the ISA + Delete the ISA Not tested - Successful subscription deletion + Successful subscription deletion Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be deleted + Subscription can be deleted Not tested - Subscription Simple + Subscription Simple - Delete Subscription + Delete Subscription - Missing version prevents deletion + Missing version prevents deletion Not tested - Incorrect version prevents deletion + Incorrect version prevents deletion Not tested - Subscription can be deleted + Subscription can be deleted Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be deleted + Subscription can be deleted Not tested - Subscription quantity limitations + Subscription quantity limitations - Clean up subscriptions + Clean up subscriptions - Subscription can be deleted + Subscription can be deleted Not tested - Subscription duration limitations + Subscription duration limitations - Remove subscription + Remove subscription - Subscription deleted + Subscription deleted @@ -3465,53 +3465,53 @@

Tested requirements

DSS0030,e Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Query Existing Subscription + Query Existing Subscription - Get Subscription by ID + Get Subscription by ID Not tested - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - Mutate Subscription + Mutate Subscription - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - Delete Subscription + Delete Subscription - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - Query Deleted Subscription + Query Deleted Subscription - Query by subscription ID should fail + Query by subscription ID should fail @@ -3519,112 +3519,112 @@

Tested requirements

DSS0030,f Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Successful subscription search query + Successful subscription search query Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Not tested - Subscription Simple + Subscription Simple - Query Existing Subscription + Query Existing Subscription - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Not tested - Created Subscription is in search results + Created Subscription is in search results Not tested - No huge search area allowed + No huge search area allowed Not tested - Query Deleted Subscription + Query Deleted Subscription - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Not tested - Search area that represents a loop is not allowed + Search area that represents a loop is not allowed Not tested - Deleted subscription should not be present in search results + Deleted subscription should not be present in search results Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Successful subscription search query + Successful subscription search query Not tested - Subscription quantity limitations + Subscription quantity limitations - Clean up subscriptions + Clean up subscriptions - Successful subscription search query + Successful subscription search query @@ -3638,16 +3638,16 @@

Tested requirements

DSS0050 Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription quantity limitations + Subscription quantity limitations - Exceed maximum number of subscriptions + Exceed maximum number of subscriptions - Enforce maximum number of subscriptions for an area + Enforce maximum number of subscriptions for an area @@ -3655,72 +3655,72 @@

Tested requirements

DSS0060 Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Create subscription validation + Create subscription validation - Returned subscription has an end time + Returned subscription has an end time Not tested - Query Existing Subscription + Query Existing Subscription - Returned subscription has an end time + Returned subscription has an end time Not tested - Mutate Subscription + Mutate Subscription - Returned subscription has an end time + Returned subscription has an end time Not tested - Delete Subscription + Delete Subscription - Returned subscription has an end time + Returned subscription has an end time Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription duration limitations + Subscription duration limitations - Try to create too-long subscription + Try to create too-long subscription - Too-long subscription creation rejected + Too-long subscription creation rejected Not tested - Try to extend subscription + Try to extend subscription - Subscription duration limited during update + Subscription duration limited during update @@ -3728,76 +3728,76 @@

Tested requirements

DSS0070 Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] returned with proper response + Subscription[P] returned with proper response Not tested - S4 + S4 - Can query all Subscriptions in area from all DSSs + Can query all Subscriptions in area from all DSSs Not tested - S7 + S7 - 404 with proper response + 404 with proper response Not tested - S8 + S8 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S9 + S9 - service_areas does not include ISA from S1 + service_areas does not include ISA from S1 Not tested - S13 + S13 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S16 + S16 - service_areas does not include ISA from S12 + service_areas does not include ISA from S12 @@ -3805,16 +3805,16 @@

Tested requirements

DSS0110 Not tested - ASTM NetRID DSS: Direct CRDB access + ASTM NetRID DSS: Direct CRDB access - Verify security interoperability + Verify security interoperability - Attempt unauthorized access + Attempt unauthorized access - CRDB node in insecure mode + CRDB node in insecure mode @@ -3822,16 +3822,16 @@

Tested requirements

DSS0120 Not tested - ASTM NetRID DSS: Direct CRDB access + ASTM NetRID DSS: Direct CRDB access - Verify security interoperability + Verify security interoperability - Verify encryption + Verify encryption - TLS in use + TLS in use @@ -3845,16 +3845,16 @@

Tested requirements

DSS0130,2,a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] ID is properly synchronized with all DSS + Subscription[P] ID is properly synchronized with all DSS @@ -3862,16 +3862,16 @@

Tested requirements

DSS0130,2,b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] owner is properly synchronized with all DSS + Subscription[P] owner is properly synchronized with all DSS @@ -3879,16 +3879,16 @@

Tested requirements

DSS0130,2,c Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] URL is properly synchronized with all DSS + Subscription[P] URL is properly synchronized with all DSS @@ -3896,16 +3896,16 @@

Tested requirements

DSS0130,2,d Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] start/end times are properly synchronized with all DSS + Subscription[P] start/end times are properly synchronized with all DSS @@ -3919,16 +3919,16 @@

Tested requirements

DSS0130,2,f Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] notification count is properly synchronized with all DSS + Subscription[P] notification count is properly synchronized with all DSS @@ -3936,26 +3936,26 @@

Tested requirements

DSS0130,3,a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - ID of ISA from S1 is properly synchronized with all DSS + ID of ISA from S1 is properly synchronized with all DSS Not tested - S5 + S5 - Can get ISA from primary DSS + Can get ISA from primary DSS @@ -3963,16 +3963,16 @@

Tested requirements

DSS0130,3,b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Owner of ISA from S1 is properly synchronized with all DSS + Owner of ISA from S1 is properly synchronized with all DSS @@ -3980,16 +3980,16 @@

Tested requirements

DSS0130,3,c Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - URL of ISA from S1 is properly synchronized with all DSS + URL of ISA from S1 is properly synchronized with all DSS @@ -3997,16 +3997,16 @@

Tested requirements

DSS0130,3,d Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Start/end times of ISA from S1 are properly synchronized with all DSS + Start/end times of ISA from S1 are properly synchronized with all DSS @@ -4014,16 +4014,16 @@

Tested requirements

DSS0130,3,e Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - service_areas includes ISA from S1 + service_areas includes ISA from S1 @@ -4031,36 +4031,36 @@

Tested requirements

DSS0130,A2-6-1,1a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S1 + S1 - ISA[P] created with proper response + ISA[P] created with proper response Not tested - S10 + S10 - ISA[P] created with proper response + ISA[P] created with proper response Not tested - S12 + S12 - ISA[P] created with proper response + ISA[P] created with proper response @@ -4068,16 +4068,16 @@

Tested requirements

DSS0130,A2-6-1,1b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S5 + S5 - Can modify ISA in primary DSS + Can modify ISA in primary DSS @@ -4085,26 +4085,26 @@

Tested requirements

DSS0130,A2-6-1,1c Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - service_areas includes ISA from S1 + service_areas includes ISA from S1 Not tested - S9 + S9 - Subscription[n] created with proper response + Subscription[n] created with proper response @@ -4112,16 +4112,16 @@

Tested requirements

DSS0130,A2-6-1,1d Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S9 + S9 - service_areas does not include ISA from S1 + service_areas does not include ISA from S1 @@ -4129,26 +4129,26 @@

Tested requirements

DSS0130,A2-6-1,2a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S11 + S11 - ISA[P] deleted with proper response + ISA[P] deleted with proper response Not tested - S15 + S15 - ISA[P] deleted with proper response + ISA[P] deleted with proper response @@ -4156,16 +4156,16 @@

Tested requirements

DSS0130,A2-6-1,2b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S16 + S16 - service_areas does not include ISA from S12 + service_areas does not include ISA from S12 @@ -4173,26 +4173,26 @@

Tested requirements

DSS0130,A2-6-1,3a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Subscription[n] created with proper response + Subscription[n] created with proper response Not tested - S16 + S16 - Subscription[n] created with proper response + Subscription[n] created with proper response @@ -4200,16 +4200,16 @@

Tested requirements

DSS0130,A2-6-1,3b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S10 + S10 - All Subscription[i] 1≤i≤n returned in subscribers + All Subscription[i] 1≤i≤n returned in subscribers @@ -4217,26 +4217,26 @@

Tested requirements

DSS0130,A2-6-1,3c Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S5 + S5 - ISA modification triggers subscription notification requests + ISA modification triggers subscription notification requests Not tested - S11 + S11 - All Subscription[i] 1≤i≤n returned in subscribers + All Subscription[i] 1≤i≤n returned in subscribers @@ -4244,46 +4244,46 @@

Tested requirements

DSS0130,A2-6-1,3d Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S12 + S12 - None of Subscription[i] 1≤i≤n returned in subscribers + None of Subscription[i] 1≤i≤n returned in subscribers Not tested - S13 + S13 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S14 + S14 - 404 with proper response + 404 with proper response Not tested - S15 + S15 - None of Subscription[i] 1≤i≤n returned in subscribers with proper response + None of Subscription[i] 1≤i≤n returned in subscribers with proper response @@ -4291,26 +4291,26 @@

Tested requirements

DSS0130,A2-6-1,4a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S6 + S6 - Subscription[n] deleted with proper response + Subscription[n] deleted with proper response Not tested - S17 + S17 - Subscription[n] deleted with proper response + Subscription[n] deleted with proper response @@ -4318,26 +4318,26 @@

Tested requirements

DSS0130,A2-6-1,4b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S7 + S7 - 404 with proper response + 404 with proper response Not tested - S8 + S8 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response @@ -4345,16 +4345,16 @@

Tested requirements

DSS0130,A2-6-1,5 Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] returned with proper response + Subscription[P] returned with proper response @@ -4362,36 +4362,36 @@

Tested requirements

DSS0130,A2-6-1,6 Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S4 + S4 - Can query all Subscriptions in area from all DSSs + Can query all Subscriptions in area from all DSSs Not tested - S8 + S8 - Subscriptions queried successfully + Subscriptions queried successfully Not tested - S13 + S13 - Subscriptions queried successfully + Subscriptions queried successfully @@ -4399,23 +4399,23 @@

Tested requirements

DSS0210 Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Prerequisites + Prerequisites - Test environment requirements + Test environment requirements - DSS instance is publicly addressable + DSS instance is publicly addressable Not tested - DSS instance is reachable + DSS instance is reachable diff --git a/artifacts/uss_qualifier/reports/dss_probing/requirements/uss2.html b/artifacts/uss_qualifier/reports/dss_probing/requirements/uss2.html index 1c26877b4e..433fd5646e 100644 --- a/artifacts/uss_qualifier/reports/dss_probing/requirements/uss2.html +++ b/artifacts/uss_qualifier/reports/dss_probing/requirements/uss2.html @@ -86,19 +86,19 @@

Test run

Test run identifier - TR-6545c01 + TR-406e487 Start time - 2023-11-07 15:06:41 UTC + 2023-11-07 16:57:58 UTC End time - 2023-11-07 15:06:47 UTC + 2023-11-07 16:58:04 UTC Test baseline identifier - TB-21813fb + TB-76b1927 Environment identifier @@ -126,7 +126,7 @@

Tested requirements

- astm
.f3411
.v19
+ astm
.f3411
.v19
DSS0010 Not tested Not implemented @@ -142,401 +142,401 @@

Tested requirements

DSS0030,a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S1 + S1 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S5 + S5 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S10 + S10 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S12 + S12 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - ASTM NetRID DSS: ISA Expiry + ASTM NetRID DSS: ISA Expiry - ISA Expiry + ISA Expiry - ISA Expiry + ISA Expiry - Create short-lived ISA + Create short-lived ISA Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Create an ISA + Create an ISA Not tested - Mutate the ISA + Mutate the ISA Not tested - Response to the mutation of the ISA contains subscription ID + Response to the mutation of the ISA contains subscription ID Not tested - Subscription to an ISA has its notification index incremented after mutation + Subscription to an ISA has its notification index incremented after mutation Not tested - Subscription to an ISA has its notification index incremented after deletion + Subscription to an ISA has its notification index incremented after deletion Not tested - ASTM NetRID DSS: Simple ISA + ASTM NetRID DSS: Simple ISA - Create and check ISA + Create and check ISA - Create ISA + Create ISA - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - ISA created + ISA created Not tested - Update and search ISA + Update and search ISA - Update ISA + Update ISA - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - ISA updated + ISA updated @@ -544,172 +544,172 @@

Tested requirements

DSS0030,b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S11 + S11 - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - S15 + S15 - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - ASTM NetRID DSS: ISA Expiry + ASTM NetRID DSS: ISA Expiry - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Response to the deletion of the ISA contains subscription ID + Response to the deletion of the ISA contains subscription ID Not tested - ASTM NetRID DSS: Simple ISA + ASTM NetRID DSS: Simple ISA - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - Delete ISA + Delete ISA - Delete with wrong version + Delete with wrong version - Delete request rejected + Delete request rejected Not tested - Delete with empty version + Delete with empty version - Delete request rejected + Delete request rejected Not tested - Delete ISA + Delete ISA - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - ISA deleted + ISA deleted Not tested - ASTM NetRID DSS: Submitted ISA Validations + ASTM NetRID DSS: Submitted ISA Validations - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA @@ -717,441 +717,441 @@

Tested requirements

DSS0030,c Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Create a subscription within the ISA footprint + Create a subscription within the ISA footprint Not tested - Subscription for the ISA's area mentions the ISA + Subscription for the ISA's area mentions the ISA Not tested - Newly created subscription has a notification_index of 0 + Newly created subscription has a notification_index of 0 Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Create subscription validation + Create subscription validation - Create subscription + Create subscription Not tested - Response to subscription creation contains a subscription + Response to subscription creation contains a subscription Not tested - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned notification index is 0 if present + Returned notification index is 0 if present Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - Query Existing Subscription + Query Existing Subscription - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Non-mutated subscription keeps the same version + Non-mutated subscription keeps the same version Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - Mutate Subscription + Mutate Subscription - Subscription can be mutated + Subscription can be mutated Not tested - Response to subscription mutation contains a subscription + Response to subscription mutation contains a subscription Not tested - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Mutated subscription version is updated + Mutated subscription version is updated Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - Delete Subscription + Delete Subscription - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Non-mutated subscription keeps the same version + Non-mutated subscription keeps the same version Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription quantity limitations + Subscription quantity limitations - Create maximum number of subscriptions + Create maximum number of subscriptions - Create up to the maximum allowed number of subscriptions in an area + Create up to the maximum allowed number of subscriptions in an area Not tested - Subscription duration limitations + Subscription duration limitations - Try to extend subscription + Try to extend subscription - Valid subscription created + Valid subscription created @@ -1159,128 +1159,128 @@

Tested requirements

DSS0030,d Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - Successful subscription deletion + Successful subscription deletion Not tested - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Delete the ISA + Delete the ISA Not tested - Successful subscription deletion + Successful subscription deletion Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be deleted + Subscription can be deleted Not tested - Subscription Simple + Subscription Simple - Delete Subscription + Delete Subscription - Missing version prevents deletion + Missing version prevents deletion Not tested - Incorrect version prevents deletion + Incorrect version prevents deletion Not tested - Subscription can be deleted + Subscription can be deleted Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be deleted + Subscription can be deleted Not tested - Subscription quantity limitations + Subscription quantity limitations - Clean up subscriptions + Clean up subscriptions - Subscription can be deleted + Subscription can be deleted Not tested - Subscription duration limitations + Subscription duration limitations - Remove subscription + Remove subscription - Subscription deleted + Subscription deleted @@ -1288,82 +1288,82 @@

Tested requirements

DSS0030,e Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be queried by ID + Subscription can be queried by ID Not tested - Subscription Simple + Subscription Simple - Query Existing Subscription + Query Existing Subscription - Get Subscription by ID + Get Subscription by ID Not tested - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - Mutate Subscription + Mutate Subscription - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - Delete Subscription + Delete Subscription - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - Query Deleted Subscription + Query Deleted Subscription - Query by subscription ID should fail + Query by subscription ID should fail Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be queried by ID + Subscription can be queried by ID @@ -1371,112 +1371,112 @@

Tested requirements

DSS0030,f Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Successful subscription search query + Successful subscription search query Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Not tested - Subscription Simple + Subscription Simple - Query Existing Subscription + Query Existing Subscription - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Not tested - Created Subscription is in search results + Created Subscription is in search results Not tested - No huge search area allowed + No huge search area allowed Not tested - Query Deleted Subscription + Query Deleted Subscription - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Not tested - Search area that represents a loop is not allowed + Search area that represents a loop is not allowed Not tested - Deleted subscription should not be present in search results + Deleted subscription should not be present in search results Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Successful subscription search query + Successful subscription search query Not tested - Subscription quantity limitations + Subscription quantity limitations - Clean up subscriptions + Clean up subscriptions - Successful subscription search query + Successful subscription search query @@ -1490,16 +1490,16 @@

Tested requirements

DSS0050 Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription quantity limitations + Subscription quantity limitations - Exceed maximum number of subscriptions + Exceed maximum number of subscriptions - Enforce maximum number of subscriptions for an area + Enforce maximum number of subscriptions for an area @@ -1507,72 +1507,72 @@

Tested requirements

DSS0060 Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Create subscription validation + Create subscription validation - Returned subscription has an end time + Returned subscription has an end time Not tested - Query Existing Subscription + Query Existing Subscription - Returned subscription has an end time + Returned subscription has an end time Not tested - Mutate Subscription + Mutate Subscription - Returned subscription has an end time + Returned subscription has an end time Not tested - Delete Subscription + Delete Subscription - Returned subscription has an end time + Returned subscription has an end time Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription duration limitations + Subscription duration limitations - Try to create too-long subscription + Try to create too-long subscription - Too-long subscription creation rejected + Too-long subscription creation rejected Not tested - Try to extend subscription + Try to extend subscription - Subscription duration limited during update + Subscription duration limited during update @@ -1580,76 +1580,76 @@

Tested requirements

DSS0070 Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] returned with proper response + Subscription[P] returned with proper response Not tested - S4 + S4 - Can query all Subscriptions in area from all DSSs + Can query all Subscriptions in area from all DSSs Not tested - S7 + S7 - 404 with proper response + 404 with proper response Not tested - S8 + S8 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S9 + S9 - service_areas does not include ISA from S1 + service_areas does not include ISA from S1 Not tested - S13 + S13 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S16 + S16 - service_areas does not include ISA from S12 + service_areas does not include ISA from S12 @@ -1657,16 +1657,16 @@

Tested requirements

DSS0110 Not tested - ASTM NetRID DSS: Direct CRDB access + ASTM NetRID DSS: Direct CRDB access - Verify security interoperability + Verify security interoperability - Attempt unauthorized access + Attempt unauthorized access - CRDB node in insecure mode + CRDB node in insecure mode @@ -1674,16 +1674,16 @@

Tested requirements

DSS0120 Not tested - ASTM NetRID DSS: Direct CRDB access + ASTM NetRID DSS: Direct CRDB access - Verify security interoperability + Verify security interoperability - Verify encryption + Verify encryption - TLS in use + TLS in use @@ -1697,16 +1697,16 @@

Tested requirements

DSS0130,2,a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] ID is properly synchronized with all DSS + Subscription[P] ID is properly synchronized with all DSS @@ -1714,16 +1714,16 @@

Tested requirements

DSS0130,2,b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] owner is properly synchronized with all DSS + Subscription[P] owner is properly synchronized with all DSS @@ -1731,16 +1731,16 @@

Tested requirements

DSS0130,2,c Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] URL is properly synchronized with all DSS + Subscription[P] URL is properly synchronized with all DSS @@ -1748,16 +1748,16 @@

Tested requirements

DSS0130,2,d Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] start/end times are properly synchronized with all DSS + Subscription[P] start/end times are properly synchronized with all DSS @@ -1771,16 +1771,16 @@

Tested requirements

DSS0130,2,f Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] notification count is properly synchronized with all DSS + Subscription[P] notification count is properly synchronized with all DSS @@ -1788,26 +1788,26 @@

Tested requirements

DSS0130,3,a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - ID of ISA from S1 is properly synchronized with all DSS + ID of ISA from S1 is properly synchronized with all DSS Not tested - S5 + S5 - Can get ISA from primary DSS + Can get ISA from primary DSS @@ -1815,16 +1815,16 @@

Tested requirements

DSS0130,3,b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Owner of ISA from S1 is properly synchronized with all DSS + Owner of ISA from S1 is properly synchronized with all DSS @@ -1832,16 +1832,16 @@

Tested requirements

DSS0130,3,c Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - URL of ISA from S1 is properly synchronized with all DSS + URL of ISA from S1 is properly synchronized with all DSS @@ -1849,16 +1849,16 @@

Tested requirements

DSS0130,3,d Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Start/end times of ISA from S1 are properly synchronized with all DSS + Start/end times of ISA from S1 are properly synchronized with all DSS @@ -1866,16 +1866,16 @@

Tested requirements

DSS0130,3,e Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - service_areas includes ISA from S1 + service_areas includes ISA from S1 @@ -1883,36 +1883,36 @@

Tested requirements

DSS0130,A2-6-1,1a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S1 + S1 - ISA[P] created with proper response + ISA[P] created with proper response Not tested - S10 + S10 - ISA[P] created with proper response + ISA[P] created with proper response Not tested - S12 + S12 - ISA[P] created with proper response + ISA[P] created with proper response @@ -1920,16 +1920,16 @@

Tested requirements

DSS0130,A2-6-1,1b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S5 + S5 - Can modify ISA in primary DSS + Can modify ISA in primary DSS @@ -1937,26 +1937,26 @@

Tested requirements

DSS0130,A2-6-1,1c Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - service_areas includes ISA from S1 + service_areas includes ISA from S1 Not tested - S9 + S9 - Subscription[n] created with proper response + Subscription[n] created with proper response @@ -1964,16 +1964,16 @@

Tested requirements

DSS0130,A2-6-1,1d Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S9 + S9 - service_areas does not include ISA from S1 + service_areas does not include ISA from S1 @@ -1981,26 +1981,26 @@

Tested requirements

DSS0130,A2-6-1,2a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S11 + S11 - ISA[P] deleted with proper response + ISA[P] deleted with proper response Not tested - S15 + S15 - ISA[P] deleted with proper response + ISA[P] deleted with proper response @@ -2008,16 +2008,16 @@

Tested requirements

DSS0130,A2-6-1,2b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S16 + S16 - service_areas does not include ISA from S12 + service_areas does not include ISA from S12 @@ -2025,26 +2025,26 @@

Tested requirements

DSS0130,A2-6-1,3a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Subscription[n] created with proper response + Subscription[n] created with proper response Not tested - S16 + S16 - Subscription[n] created with proper response + Subscription[n] created with proper response @@ -2052,16 +2052,16 @@

Tested requirements

DSS0130,A2-6-1,3b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S10 + S10 - All Subscription[i] 1≤i≤n returned in subscribers + All Subscription[i] 1≤i≤n returned in subscribers @@ -2069,26 +2069,26 @@

Tested requirements

DSS0130,A2-6-1,3c Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S5 + S5 - ISA modification triggers subscription notification requests + ISA modification triggers subscription notification requests Not tested - S11 + S11 - All Subscription[i] 1≤i≤n returned in subscribers + All Subscription[i] 1≤i≤n returned in subscribers @@ -2096,46 +2096,46 @@

Tested requirements

DSS0130,A2-6-1,3d Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S12 + S12 - None of Subscription[i] 1≤i≤n returned in subscribers + None of Subscription[i] 1≤i≤n returned in subscribers Not tested - S13 + S13 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S14 + S14 - 404 with proper response + 404 with proper response Not tested - S15 + S15 - None of Subscription[i] 1≤i≤n returned in subscribers with proper response + None of Subscription[i] 1≤i≤n returned in subscribers with proper response @@ -2143,26 +2143,26 @@

Tested requirements

DSS0130,A2-6-1,4a Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S6 + S6 - Subscription[n] deleted with proper response + Subscription[n] deleted with proper response Not tested - S17 + S17 - Subscription[n] deleted with proper response + Subscription[n] deleted with proper response @@ -2170,26 +2170,26 @@

Tested requirements

DSS0130,A2-6-1,4b Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S7 + S7 - 404 with proper response + 404 with proper response Not tested - S8 + S8 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response @@ -2197,16 +2197,16 @@

Tested requirements

DSS0130,A2-6-1,5 Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] returned with proper response + Subscription[P] returned with proper response @@ -2214,36 +2214,36 @@

Tested requirements

DSS0130,A2-6-1,6 Not tested - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S4 + S4 - Can query all Subscriptions in area from all DSSs + Can query all Subscriptions in area from all DSSs Not tested - S8 + S8 - Subscriptions queried successfully + Subscriptions queried successfully Not tested - S13 + S13 - Subscriptions queried successfully + Subscriptions queried successfully @@ -2251,28 +2251,28 @@

Tested requirements

DSS0210 Pass - ASTM F3411-19 NetRID DSS interoperability + ASTM F3411-19 NetRID DSS interoperability - Prerequisites + Prerequisites - Test environment requirements + Test environment requirements - DSS instance is publicly addressable + DSS instance is publicly addressable Pass - DSS instance is reachable + DSS instance is reachable - astm
.f3411
.v22a
+ astm
.f3411
.v22a
DSS0010 Not tested Not implemented @@ -2288,401 +2288,401 @@

Tested requirements

DSS0030,a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S1 + S1 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S5 + S5 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S10 + S10 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - S12 + S12 - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - ASTM NetRID DSS: ISA Expiry + ASTM NetRID DSS: ISA Expiry - ISA Expiry + ISA Expiry - ISA Expiry + ISA Expiry - Create short-lived ISA + Create short-lived ISA Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Create an ISA + Create an ISA Not tested - Mutate the ISA + Mutate the ISA Not tested - Response to the mutation of the ISA contains subscription ID + Response to the mutation of the ISA contains subscription ID Not tested - Subscription to an ISA has its notification index incremented after mutation + Subscription to an ISA has its notification index incremented after mutation Not tested - Subscription to an ISA has its notification index incremented after deletion + Subscription to an ISA has its notification index incremented after deletion Not tested - ASTM NetRID DSS: Simple ISA + ASTM NetRID DSS: Simple ISA - Create and check ISA + Create and check ISA - Create ISA + Create ISA - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - ISA created + ISA created Not tested - Update and search ISA + Update and search ISA - Update ISA + Update ISA - ISA response code + ISA response code Not tested - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version changed + ISA version changed Not tested - ISA start time matches + ISA start time matches Not tested - ISA end time matches + ISA end time matches Not tested - ISA URL matches + ISA URL matches Not tested - ISA updated + ISA updated @@ -2690,172 +2690,172 @@

Tested requirements

DSS0030,b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S11 + S11 - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - S15 + S15 - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - ASTM NetRID DSS: ISA Expiry + ASTM NetRID DSS: ISA Expiry - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Response to the deletion of the ISA contains subscription ID + Response to the deletion of the ISA contains subscription ID Not tested - ASTM NetRID DSS: Simple ISA + ASTM NetRID DSS: Simple ISA - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - Delete ISA + Delete ISA - Delete with wrong version + Delete with wrong version - Delete request rejected + Delete request rejected Not tested - Delete with empty version + Delete with empty version - Delete request rejected + Delete request rejected Not tested - Delete ISA + Delete ISA - ISA response format + ISA response format Not tested - ISA ID matches + ISA ID matches Not tested - ISA version matches + ISA version matches Not tested - ISA deleted + ISA deleted Not tested - ASTM NetRID DSS: Submitted ISA Validations + ASTM NetRID DSS: Submitted ISA Validations - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA @@ -2863,441 +2863,441 @@

Tested requirements

DSS0030,c Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Create a subscription within the ISA footprint + Create a subscription within the ISA footprint Not tested - Subscription for the ISA's area mentions the ISA + Subscription for the ISA's area mentions the ISA Not tested - Newly created subscription has a notification_index of 0 + Newly created subscription has a notification_index of 0 Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Create subscription validation + Create subscription validation - Create subscription + Create subscription Not tested - Response to subscription creation contains a subscription + Response to subscription creation contains a subscription Not tested - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned notification index is 0 if present + Returned notification index is 0 if present Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - Query Existing Subscription + Query Existing Subscription - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Non-mutated subscription keeps the same version + Non-mutated subscription keeps the same version Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - Mutate Subscription + Mutate Subscription - Subscription can be mutated + Subscription can be mutated Not tested - Response to subscription mutation contains a subscription + Response to subscription mutation contains a subscription Not tested - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Mutated subscription version is updated + Mutated subscription version is updated Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - Delete Subscription + Delete Subscription - Returned subscription has an ID + Returned subscription has an ID Not tested - Returned subscription ID is correct + Returned subscription ID is correct Not tested - Returned subscription has an owner + Returned subscription has an owner Not tested - Returned subscription owner is correct + Returned subscription owner is correct Not tested - Returned subscription has an ISA URL + Returned subscription has an ISA URL Not tested - Returned ISA URL has correct base URL + Returned ISA URL has correct base URL Not tested - Returned subscription has a start time + Returned subscription has a start time Not tested - Returned start time is correct + Returned start time is correct Not tested - Returned end time is correct + Returned end time is correct Not tested - Returned subscription has a version + Returned subscription has a version Not tested - Non-mutated subscription keeps the same version + Non-mutated subscription keeps the same version Not tested - Generated subscription version has proper format + Generated subscription version has proper format Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription quantity limitations + Subscription quantity limitations - Create maximum number of subscriptions + Create maximum number of subscriptions - Create up to the maximum allowed number of subscriptions in an area + Create up to the maximum allowed number of subscriptions in an area Not tested - Subscription duration limitations + Subscription duration limitations - Try to extend subscription + Try to extend subscription - Valid subscription created + Valid subscription created @@ -3305,128 +3305,128 @@

Tested requirements

DSS0030,d Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Removed pre-existing ISA + Removed pre-existing ISA Not tested - Successful subscription deletion + Successful subscription deletion Not tested - ISA Subscription Interactions + ISA Subscription Interactions - ISA Subscription Interactions + ISA Subscription Interactions - Delete the ISA + Delete the ISA Not tested - Successful subscription deletion + Successful subscription deletion Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be deleted + Subscription can be deleted Not tested - Subscription Simple + Subscription Simple - Delete Subscription + Delete Subscription - Missing version prevents deletion + Missing version prevents deletion Not tested - Incorrect version prevents deletion + Incorrect version prevents deletion Not tested - Subscription can be deleted + Subscription can be deleted Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Subscription can be deleted + Subscription can be deleted Not tested - Subscription quantity limitations + Subscription quantity limitations - Clean up subscriptions + Clean up subscriptions - Subscription can be deleted + Subscription can be deleted Not tested - Subscription duration limitations + Subscription duration limitations - Remove subscription + Remove subscription - Subscription deleted + Subscription deleted @@ -3434,53 +3434,53 @@

Tested requirements

DSS0030,e Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Query Existing Subscription + Query Existing Subscription - Get Subscription by ID + Get Subscription by ID Not tested - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - Mutate Subscription + Mutate Subscription - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - Delete Subscription + Delete Subscription - Returned notification index is equal to or greater than 0 + Returned notification index is equal to or greater than 0 Not tested - Query Deleted Subscription + Query Deleted Subscription - Query by subscription ID should fail + Query by subscription ID should fail @@ -3488,112 +3488,112 @@

Tested requirements

DSS0030,f Not tested - ASTM NetRID DSS: ISA Subscription Interactions + ASTM NetRID DSS: ISA Subscription Interactions - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Successful subscription search query + Successful subscription search query Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Not tested - Subscription Simple + Subscription Simple - Query Existing Subscription + Query Existing Subscription - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Not tested - Created Subscription is in search results + Created Subscription is in search results Not tested - No huge search area allowed + No huge search area allowed Not tested - Query Deleted Subscription + Query Deleted Subscription - Search for all subscriptions in ISA area + Search for all subscriptions in ISA area Not tested - Search area that represents a loop is not allowed + Search area that represents a loop is not allowed Not tested - Deleted subscription should not be present in search results + Deleted subscription should not be present in search results Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Setup + Setup - Ensure clean workspace + Ensure clean workspace - Successful subscription search query + Successful subscription search query Not tested - Subscription quantity limitations + Subscription quantity limitations - Clean up subscriptions + Clean up subscriptions - Successful subscription search query + Successful subscription search query @@ -3607,16 +3607,16 @@

Tested requirements

DSS0050 Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription quantity limitations + Subscription quantity limitations - Exceed maximum number of subscriptions + Exceed maximum number of subscriptions - Enforce maximum number of subscriptions for an area + Enforce maximum number of subscriptions for an area @@ -3624,72 +3624,72 @@

Tested requirements

DSS0060 Not tested - ASTM NetRID DSS: Subscription Simple + ASTM NetRID DSS: Subscription Simple - Subscription Simple + Subscription Simple - Create subscription validation + Create subscription validation - Returned subscription has an end time + Returned subscription has an end time Not tested - Query Existing Subscription + Query Existing Subscription - Returned subscription has an end time + Returned subscription has an end time Not tested - Mutate Subscription + Mutate Subscription - Returned subscription has an end time + Returned subscription has an end time Not tested - Delete Subscription + Delete Subscription - Returned subscription has an end time + Returned subscription has an end time Not tested - ASTM NetRID DSS: Subscription Validation + ASTM NetRID DSS: Subscription Validation - Subscription duration limitations + Subscription duration limitations - Try to create too-long subscription + Try to create too-long subscription - Too-long subscription creation rejected + Too-long subscription creation rejected Not tested - Try to extend subscription + Try to extend subscription - Subscription duration limited during update + Subscription duration limited during update @@ -3697,76 +3697,76 @@

Tested requirements

DSS0070 Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] returned with proper response + Subscription[P] returned with proper response Not tested - S4 + S4 - Can query all Subscriptions in area from all DSSs + Can query all Subscriptions in area from all DSSs Not tested - S7 + S7 - 404 with proper response + 404 with proper response Not tested - S8 + S8 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S9 + S9 - service_areas does not include ISA from S1 + service_areas does not include ISA from S1 Not tested - S13 + S13 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S16 + S16 - service_areas does not include ISA from S12 + service_areas does not include ISA from S12 @@ -3774,16 +3774,16 @@

Tested requirements

DSS0110 Not tested - ASTM NetRID DSS: Direct CRDB access + ASTM NetRID DSS: Direct CRDB access - Verify security interoperability + Verify security interoperability - Attempt unauthorized access + Attempt unauthorized access - CRDB node in insecure mode + CRDB node in insecure mode @@ -3791,16 +3791,16 @@

Tested requirements

DSS0120 Not tested - ASTM NetRID DSS: Direct CRDB access + ASTM NetRID DSS: Direct CRDB access - Verify security interoperability + Verify security interoperability - Verify encryption + Verify encryption - TLS in use + TLS in use @@ -3814,16 +3814,16 @@

Tested requirements

DSS0130,2,a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] ID is properly synchronized with all DSS + Subscription[P] ID is properly synchronized with all DSS @@ -3831,16 +3831,16 @@

Tested requirements

DSS0130,2,b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] owner is properly synchronized with all DSS + Subscription[P] owner is properly synchronized with all DSS @@ -3848,16 +3848,16 @@

Tested requirements

DSS0130,2,c Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] URL is properly synchronized with all DSS + Subscription[P] URL is properly synchronized with all DSS @@ -3865,16 +3865,16 @@

Tested requirements

DSS0130,2,d Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] start/end times are properly synchronized with all DSS + Subscription[P] start/end times are properly synchronized with all DSS @@ -3888,16 +3888,16 @@

Tested requirements

DSS0130,2,f Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] notification count is properly synchronized with all DSS + Subscription[P] notification count is properly synchronized with all DSS @@ -3905,26 +3905,26 @@

Tested requirements

DSS0130,3,a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - ID of ISA from S1 is properly synchronized with all DSS + ID of ISA from S1 is properly synchronized with all DSS Not tested - S5 + S5 - Can get ISA from primary DSS + Can get ISA from primary DSS @@ -3932,16 +3932,16 @@

Tested requirements

DSS0130,3,b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Owner of ISA from S1 is properly synchronized with all DSS + Owner of ISA from S1 is properly synchronized with all DSS @@ -3949,16 +3949,16 @@

Tested requirements

DSS0130,3,c Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - URL of ISA from S1 is properly synchronized with all DSS + URL of ISA from S1 is properly synchronized with all DSS @@ -3966,16 +3966,16 @@

Tested requirements

DSS0130,3,d Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Start/end times of ISA from S1 are properly synchronized with all DSS + Start/end times of ISA from S1 are properly synchronized with all DSS @@ -3983,16 +3983,16 @@

Tested requirements

DSS0130,3,e Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - service_areas includes ISA from S1 + service_areas includes ISA from S1 @@ -4000,36 +4000,36 @@

Tested requirements

DSS0130,A2-6-1,1a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S1 + S1 - ISA[P] created with proper response + ISA[P] created with proper response Not tested - S10 + S10 - ISA[P] created with proper response + ISA[P] created with proper response Not tested - S12 + S12 - ISA[P] created with proper response + ISA[P] created with proper response @@ -4037,16 +4037,16 @@

Tested requirements

DSS0130,A2-6-1,1b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S5 + S5 - Can modify ISA in primary DSS + Can modify ISA in primary DSS @@ -4054,26 +4054,26 @@

Tested requirements

DSS0130,A2-6-1,1c Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - service_areas includes ISA from S1 + service_areas includes ISA from S1 Not tested - S9 + S9 - Subscription[n] created with proper response + Subscription[n] created with proper response @@ -4081,16 +4081,16 @@

Tested requirements

DSS0130,A2-6-1,1d Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S9 + S9 - service_areas does not include ISA from S1 + service_areas does not include ISA from S1 @@ -4098,26 +4098,26 @@

Tested requirements

DSS0130,A2-6-1,2a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S11 + S11 - ISA[P] deleted with proper response + ISA[P] deleted with proper response Not tested - S15 + S15 - ISA[P] deleted with proper response + ISA[P] deleted with proper response @@ -4125,16 +4125,16 @@

Tested requirements

DSS0130,A2-6-1,2b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S16 + S16 - service_areas does not include ISA from S12 + service_areas does not include ISA from S12 @@ -4142,26 +4142,26 @@

Tested requirements

DSS0130,A2-6-1,3a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S2 + S2 - Subscription[n] created with proper response + Subscription[n] created with proper response Not tested - S16 + S16 - Subscription[n] created with proper response + Subscription[n] created with proper response @@ -4169,16 +4169,16 @@

Tested requirements

DSS0130,A2-6-1,3b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S10 + S10 - All Subscription[i] 1≤i≤n returned in subscribers + All Subscription[i] 1≤i≤n returned in subscribers @@ -4186,26 +4186,26 @@

Tested requirements

DSS0130,A2-6-1,3c Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S5 + S5 - ISA modification triggers subscription notification requests + ISA modification triggers subscription notification requests Not tested - S11 + S11 - All Subscription[i] 1≤i≤n returned in subscribers + All Subscription[i] 1≤i≤n returned in subscribers @@ -4213,46 +4213,46 @@

Tested requirements

DSS0130,A2-6-1,3d Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S12 + S12 - None of Subscription[i] 1≤i≤n returned in subscribers + None of Subscription[i] 1≤i≤n returned in subscribers Not tested - S13 + S13 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response Not tested - S14 + S14 - 404 with proper response + 404 with proper response Not tested - S15 + S15 - None of Subscription[i] 1≤i≤n returned in subscribers with proper response + None of Subscription[i] 1≤i≤n returned in subscribers with proper response @@ -4260,26 +4260,26 @@

Tested requirements

DSS0130,A2-6-1,4a Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S6 + S6 - Subscription[n] deleted with proper response + Subscription[n] deleted with proper response Not tested - S17 + S17 - Subscription[n] deleted with proper response + Subscription[n] deleted with proper response @@ -4287,26 +4287,26 @@

Tested requirements

DSS0130,A2-6-1,4b Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S7 + S7 - 404 with proper response + 404 with proper response Not tested - S8 + S8 - No Subscription[i] 1≤i≤n returned with proper response + No Subscription[i] 1≤i≤n returned with proper response @@ -4314,16 +4314,16 @@

Tested requirements

DSS0130,A2-6-1,5 Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S3 + S3 - Subscription[P] returned with proper response + Subscription[P] returned with proper response @@ -4331,36 +4331,36 @@

Tested requirements

DSS0130,A2-6-1,6 Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Interoperability sequence + Interoperability sequence - S4 + S4 - Can query all Subscriptions in area from all DSSs + Can query all Subscriptions in area from all DSSs Not tested - S8 + S8 - Subscriptions queried successfully + Subscriptions queried successfully Not tested - S13 + S13 - Subscriptions queried successfully + Subscriptions queried successfully @@ -4368,23 +4368,23 @@

Tested requirements

DSS0210 Not tested - ASTM F3411-22a NetRID DSS interoperability + ASTM F3411-22a NetRID DSS interoperability - Prerequisites + Prerequisites - Test environment requirements + Test environment requirements - DSS instance is publicly addressable + DSS instance is publicly addressable Not tested - DSS instance is reachable + DSS instance is reachable diff --git a/artifacts/uss_qualifier/reports/dss_probing/sequence/index.html b/artifacts/uss_qualifier/reports/dss_probing/sequence/index.html index 15a6d8db08..1acd87db58 100644 --- a/artifacts/uss_qualifier/reports/dss_probing/sequence/index.html +++ b/artifacts/uss_qualifier/reports/dss_probing/sequence/index.html @@ -1,7 +1,7 @@ - TR-6545c01 sequence view + TR-406e487 sequence view