Skip to content

Commit

Permalink
[uss_qualifier] Add report evaluation to uss_qualifier (#257)
Browse files Browse the repository at this point in the history 
* Add report validation to uss_qualifier

* Fix missing resource in dss_probing dev configuration

* Fix lint efddd75
  • Loading branch information
@github-actions
github-actions[bot] committed Oct 17, 2023
1 parent f816ced commit d878d2d
Show file tree
Hide file tree
Showing 34 changed files with 441,493 additions and 4,687 deletions.
2 changes: 1 addition & 1 deletion artifacts/uss_qualifier/reports/capabilities_uspace.html
View file

Large diffs are not rendered by default.

189 changes: 176 additions & 13 deletions artifacts/uss_qualifier/reports/sequence_uspace/index.html
View file
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
<!DOCTYPE html>
<html lang="en">
<head>
<title>TR-7219f31 sequence view</title>
<title>TR-af345e0 sequence view</title>
<style>
body {
margin: 0;
Expand Down Expand Up @@ -103,31 +103,31 @@ <h1>Sequence view of uss_qualifier test run</h1>
</tr>
<tr>
<td>Test run identifier</td>
<td>TR-7219f31</td>
<td>TR-af345e0</td>
</tr>
<tr>
<td>Start time</td>
<td>2023-10-17 13:38:29 UTC</td>
<td>2023-10-17 13:38:31 UTC</td>
</tr>
<tr>
<td>End time</td>
<td>2023-10-17 13:38:58 UTC</td>
<td>2023-10-17 13:41:57 UTC</td>
</tr>
<tr>
<td>Test baseline identifier</td>
<td>TB-9b29485</td>
<td>TB-5d2fb42</td>
</tr>
<tr>
<td>Environment identifier</td>
<td>TE-71d4501</td>
</tr>
<tr>
<td>Codebase version</td>
<td>interuss/monitoring/v0.0.0-aba7a21</td>
<td>interuss/monitoring/v0.0.0-efddd75</td>
</tr>
<tr>
<td>Commit hash</td>
<td>aba7a21a1964d329cbea8a63f761254e7f64fb1d</td>
<td>efddd75a2b93d2e63dc9ff56a552f34e67ba7ad7</td>
</tr>
</table>
</div>
Expand Down Expand Up @@ -2395,7 +2395,7 @@ <h2>Scenarios executed</h2>
<th>uss2</th>
</tr>
<tr>
<td rowspan="8" colspan="1">action_generators.interuss.mock_uss.WithLocality</td>
<td rowspan="30" colspan="1">action_generators.interuss.mock_uss.WithLocality</td>
<td rowspan="1" colspan="5">&rarr;</td>
<td>
<a href="s1.html">Configure mock_uss locality</a>
Expand All @@ -2404,9 +2404,9 @@ <h2>Scenarios executed</h2>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td rowspan="7" colspan="1">U-space required services</td>
<td rowspan="7" colspan="1">U-space flight authorisation</td>
<td rowspan="7" colspan="1">ASTM F3548-21</td>
<td rowspan="28" colspan="1">U-space required services</td>
<td rowspan="14" colspan="1">U-space flight authorisation</td>
<td rowspan="12" colspan="1">ASTM F3548-21</td>
<td rowspan="2" colspan="1">action_generators.astm.f3548.ForEachDSS</td>
<td rowspan="1" colspan="1">DSS testing for ASTM NetRID F3558-21</td>
<td>
Expand Down Expand Up @@ -2439,7 +2439,7 @@ <h2>Scenarios executed</h2>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td rowspan="3" colspan="2">action_generators.flight_planning.FlightPlannerCombinations</td>
<td rowspan="4" colspan="2">action_generators.flight_planning.FlightPlannerCombinations</td>
<td>
<a href="s6.html">Nominal planning: conflict with higher priority</a>
</td>
Expand All @@ -2457,7 +2457,170 @@ <h2>Scenarios executed</h2>
<td>
<a href="s8.html">Nominal planning: conflict with higher priority</a>
</td>
<td class="fail_result">&#x274C;</td>
<td class="pass_result">&#x2705;</td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td>
<a href="s9.html">Nominal planning: conflict with higher priority</a>
</td>
<td class="pass_result">&#x2705;</td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td rowspan="4" colspan="2">action_generators.flight_planning.FlightPlannerCombinations</td>
<td>
<a href="s10.html">Nominal planning: not permitted conflict with equal priority</a>
</td>
<td class="pass_result">&#x2705;</td>
<td></td>
</tr>
<tr>
<td>
<a href="s11.html">Nominal planning: not permitted conflict with equal priority</a>
</td>
<td class="pass_result">&#x2705;</td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td>
<a href="s12.html">Nominal planning: not permitted conflict with equal priority</a>
</td>
<td class="pass_result">&#x2705;</td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td>
<a href="s13.html">Nominal planning: not permitted conflict with equal priority</a>
</td>
<td class="pass_result">&#x2705;</td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td rowspan="2" colspan="3">action_generators.flight_planning.FlightPlannerCombinations</td>
<td>
<a href="s14.html">Flight authorisation validation</a>
</td>
<td class="pass_result">&#x2705;</td>
<td></td>
</tr>
<tr>
<td>
<a href="s15.html">Flight authorisation validation</a>
</td>
<td></td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td rowspan="14" colspan="1">U-Space network identification</td>
<td rowspan="14" colspan="1">ASTM F3411-22a</td>
<td rowspan="10" colspan="1">action_generators.astm.f3411.ForEachDSS</td>
<td rowspan="5" colspan="1">DSS testing for ASTM NetRID F3411-22a</td>
<td>
<a href="s16.html">ASTM NetRID DSS: Simple ISA</a>
</td>
<td class="pass_result">&#x2705;</td>
<td></td>
</tr>
<tr>
<td>
<a href="s17.html">ASTM NetRID DSS: Submitted ISA Validations</a>
</td>
<td class="pass_result">&#x2705;</td>
<td></td>
</tr>
<tr>
<td>
<a href="s18.html">ASTM NetRID DSS: Subscription Validation</a>
</td>
<td class="pass_result">&#x2705;</td>
<td></td>
</tr>
<tr>
<td>
<a href="s19.html">ASTM F3411-22a NetRID DSS interoperability</a>
</td>
<td class="pass_result">&#x2705;</td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td>
<a href="s20.html">ASTM NetRID DSS: Direct CRDB access</a>
</td>
<td></td>
<td></td>
</tr>
<tr>
<td rowspan="5" colspan="1">DSS testing for ASTM NetRID F3411-22a</td>
<td>
<a href="s21.html">ASTM NetRID DSS: Simple ISA</a>
</td>
<td></td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td>
<a href="s22.html">ASTM NetRID DSS: Submitted ISA Validations</a>
</td>
<td></td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td>
<a href="s23.html">ASTM NetRID DSS: Subscription Validation</a>
</td>
<td></td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td>
<a href="s24.html">ASTM F3411-22a NetRID DSS interoperability</a>
</td>
<td class="pass_result">&#x2705;</td>
<td class="pass_result">&#x2705;</td>
</tr>
<tr>
<td>
<a href="s25.html">ASTM NetRID DSS: Direct CRDB access</a>
</td>
<td></td>
<td></td>
</tr>
<tr>
<td rowspan="4" colspan="2">&rarr;</td>
<td>
<a href="s26.html">ASTM NetRID nominal behavior</a>
</td>
<td class="pass_result">&#x2705;</td>
<td></td>
</tr>
<tr>
<td>
<a href="s27.html">ASTM NetRID SP clients misbehavior handling</a>
</td>
<td class="pass_result">&#x2705;</td>
<td></td>
</tr>
<tr>
<td>
<a href="s28.html">ASTM NetRID: Operator interactions</a>
</td>
<td></td>
<td></td>
</tr>
<tr>
<td>
<a href="s29.html">ASTM F3411-22a NetRID aggregate checks</a>
</td>
<td class="pass_result">&#x2705;</td>
<td></td>
</tr>
<tr>
<td rowspan="1" colspan="5">&rarr;</td>
<td>
<a href="s30.html">Unconfigure mock_uss locality</a>
</td>
<td class="pass_result">&#x2705;</td>
<td class="pass_result">&#x2705;</td>
</tr>
</table>
Expand Down
Loading

0 comments on commit d878d2d

Please sign in to comment.