Skip to content
Lint

[optimizer][docs] Add Tutorial for Optimizer API #6534

Sign in to view logs

[optimizer][docs] Add Tutorial for Optimizer API

[optimizer][docs] Add Tutorial for Optimizer API #6534

GitHub Actions / Test Results failed May 2, 2024 in 0s

3 fail, 1 479 skipped, 2 422 pass in 3h 11m 11s

     30 files  +     14      30 suites  +14   3h 11m 11s ⏱️ + 2h 58m 50s
  3 904 tests +    598   2 422 ✅  -    148    1 479 💤 +    744   3 ❌ + 2 
564 362 runs  +531 930  88 062 ✅ +62 134  476 243 💤 +469 740  57 ❌ +56 

Results for commit 945a45d. ± Comparison against earlier commit 7a9e68a.

Annotations

Check warning on line 0 in tests.functions.gemmgelu_test.TestGemmGelu

See this annotation in the file changed.

@github-actions github-actions / Test Results

1 out of 24 runs failed: test_gemmgelu (tests.functions.gemmgelu_test.TestGemmGelu) 

artifacts/Test Results (py311-ort-nightly-macos-latest)/pytest.xml [took 0s]
Raw output 
AssertionError: 
Not equal to tolerance rtol=1e-07, atol=0

Mismatched elements: 1 / 16 (6.25%)
Max absolute difference: 2.3841858e-07
Max relative difference: 1.5581162e-07
 x: array([[[1.608876, 1.258398, 1.868434, 1.530172, 1.502594, 1.577003,
         0.930287, 1.438904],
        [2.2129  , 1.367099, 2.42691 , 2.158696, 1.992608, 2.096078,
         1.297177, 2.084625]]], dtype=float32)
 y: array([[[1.608876, 1.258398, 1.868434, 1.530172, 1.502594, 1.577003,
         0.930287, 1.438904],
        [2.2129  , 1.367099, 2.42691 , 2.158696, 1.992608, 2.096078,
         1.297177, 2.084625]]], dtype=float32)
tests/functions/gemmgelu_test.py:62: in test_gemmgelu
    self.run_converter_test(case)
tests/common/onnx_script_test_case.py:255: in run_converter_test
    np.testing.assert_allclose(actual, param.output, rtol=self.rtol)
/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/contextlib.py:81: in inner
    return func(*args, **kwds)
E   AssertionError: 
E   Not equal to tolerance rtol=1e-07, atol=0
E   
E   Mismatched elements: 1 / 16 (6.25%)
E   Max absolute difference: 2.3841858e-07
E   Max relative difference: 1.5581162e-07
E    x: array([[[1.608876, 1.258398, 1.868434, 1.530172, 1.502594, 1.577003,
E            0.930287, 1.438904],
E           [2.2129  , 1.367099, 2.42691 , 2.158696, 1.992608, 2.096078,
E            1.297177, 2.084625]]], dtype=float32)
E    y: array([[[1.608876, 1.258398, 1.868434, 1.530172, 1.502594, 1.577003,
E            0.930287, 1.438904],
E           [2.2129  , 1.367099, 2.42691 , 2.158696, 1.992608, 2.096078,
E            1.297177, 2.084625]]], dtype=float32)

Check warning on line 0 in tests.function_libs.torch_lib.ops_test.TestOutputConsistencyEagerCPU

See this annotation in the file changed.

@github-actions github-actions / Test Results

7 out of 30 runs failed: test_output_match_opinfo__native_layer_norm_cpu_float32 (tests.function_libs.torch_lib.ops_test.TestOutputConsistencyEagerCPU) 

artifacts/Test Results (py310-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-onnx-weekly-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-torch-nightly-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py312-torch-nightly-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py38-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py39-macos-latest)/pytest.xml [took 0s]
Raw output 
AssertionError: Output 2 mismatch
AssertionError: Output 2 mismatch
AssertionError: Output 2 mismatch
AssertionError: Output 2 mismatch
tests/function_libs/torch_lib/ops_test.py:279: in run_test_output_match
    torch.testing.assert_close(
E   AssertionError: Tensor-likes are not close!
E   
E   Mismatched elements: 1 / 1 (100.0%)
E   Greatest absolute difference: 1.154693603515625 at index (0,) (up to 0.00018 allowed)
E   Greatest relative difference: 0.0036514615640044212 at index (0,) (up to 3.7e-05 allowed)

The above exception was the direct cause of the following exception:
tests/function_libs/torch_lib/ops_test.py:293: in run_test_output_match
    raise AssertionError(f"Output {j} mismatch") from e
E   AssertionError: Output 2 mismatch
tests/function_libs/torch_lib/ops_test.py:279: in run_test_output_match
    torch.testing.assert_close(
E   AssertionError: Tensor-likes are not close!
E   
E   Mismatched elements: 1 / 1 (100.0%)
E   Greatest absolute difference: 15.526153564453125 at index (0,) (up to 0.00018 allowed)
E   Greatest relative difference: 0.04909800738096237 at index (0,) (up to 3.7e-05 allowed)

The above exception was the direct cause of the following exception:
tests/function_libs/torch_lib/ops_test.py:293: in run_test_output_match
    raise AssertionError(f"Output {j} mismatch") from e
E   AssertionError: Output 2 mismatch
tests/function_libs/torch_lib/ops_test.py:279: in run_test_output_match
    torch.testing.assert_close(
E   AssertionError: Tensor-likes are not close!
E   
E   Mismatched elements: 1 / 1 (100.0%)
E   Greatest absolute difference: 4.3814697265625 at index (0,) (up to 0.00018 allowed)
E   Greatest relative difference: 0.013855422846972942 at index (0,) (up to 3.7e-05 allowed)

The above exception was the direct cause of the following exception:
tests/function_libs/torch_lib/ops_test.py:293: in run_test_output_match
    raise AssertionError(f"Output {j} mismatch") from e
E   AssertionError: Output 2 mismatch
tests/function_libs/torch_lib/ops_test.py:279: in run_test_output_match
    torch.testing.assert_close(
E   AssertionError: Tensor-likes are not close!
E   
E   Mismatched elements: 1 / 1 (100.0%)
E   Greatest absolute difference: 3.34576416015625 at index (0,) (up to 0.00018 allowed)
E   Greatest relative difference: 0.010580234229564667 at index (0,) (up to 3.7e-05 allowed)

The above exception was the direct cause of the following exception:
tests/function_libs/torch_lib/ops_test.py:293: in run_test_output_match
    raise AssertionError(f"Output {j} mismatch") from e
E   AssertionError: Output 2 mismatch

Check warning on line 0 in tests.function_libs.torch_lib.ops_test.TestOutputConsistencyFullGraphCPU

See this annotation in the file changed.

@github-actions github-actions / Test Results

7 out of 30 runs failed: test_output_match_opinfo__native_layer_norm_cpu_float32 (tests.function_libs.torch_lib.ops_test.TestOutputConsistencyFullGraphCPU) 

artifacts/Test Results (py310-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-onnx-weekly-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-torch-nightly-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py312-torch-nightly-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py38-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py39-macos-latest)/pytest.xml [took 0s]
Raw output 
AssertionError: Output 2 mismatch
AssertionError: Output 2 mismatch
AssertionError: Output 2 mismatch
AssertionError: Output 2 mismatch
tests/function_libs/torch_lib/ops_test.py:279: in run_test_output_match
    torch.testing.assert_close(
E   AssertionError: Tensor-likes are not close!
E   
E   Mismatched elements: 1 / 1 (100.0%)
E   Greatest absolute difference: 1.154693603515625 at index (0,) (up to 0.00018 allowed)
E   Greatest relative difference: 0.0036514615640044212 at index (0,) (up to 3.7e-05 allowed)

The above exception was the direct cause of the following exception:
tests/function_libs/torch_lib/ops_test.py:293: in run_test_output_match
    raise AssertionError(f"Output {j} mismatch") from e
E   AssertionError: Output 2 mismatch
tests/function_libs/torch_lib/ops_test.py:279: in run_test_output_match
    torch.testing.assert_close(
E   AssertionError: Tensor-likes are not close!
E   
E   Mismatched elements: 1 / 1 (100.0%)
E   Greatest absolute difference: 15.526153564453125 at index (0,) (up to 0.00018 allowed)
E   Greatest relative difference: 0.04909800738096237 at index (0,) (up to 3.7e-05 allowed)

The above exception was the direct cause of the following exception:
tests/function_libs/torch_lib/ops_test.py:293: in run_test_output_match
    raise AssertionError(f"Output {j} mismatch") from e
E   AssertionError: Output 2 mismatch
tests/function_libs/torch_lib/ops_test.py:279: in run_test_output_match
    torch.testing.assert_close(
E   AssertionError: Tensor-likes are not close!
E   
E   Mismatched elements: 1 / 1 (100.0%)
E   Greatest absolute difference: 4.3814697265625 at index (0,) (up to 0.00018 allowed)
E   Greatest relative difference: 0.013855422846972942 at index (0,) (up to 3.7e-05 allowed)

The above exception was the direct cause of the following exception:
tests/function_libs/torch_lib/ops_test.py:293: in run_test_output_match
    raise AssertionError(f"Output {j} mismatch") from e
E   AssertionError: Output 2 mismatch
tests/function_libs/torch_lib/ops_test.py:279: in run_test_output_match
    torch.testing.assert_close(
E   AssertionError: Tensor-likes are not close!
E   
E   Mismatched elements: 1 / 1 (100.0%)
E   Greatest absolute difference: 3.34576416015625 at index (0,) (up to 0.00018 allowed)
E   Greatest relative difference: 0.010580234229564667 at index (0,) (up to 3.7e-05 allowed)

The above exception was the direct cause of the following exception:
tests/function_libs/torch_lib/ops_test.py:293: in run_test_output_match
    raise AssertionError(f"Output {j} mismatch") from e
E   AssertionError: Output 2 mismatch
View more details on GitHub Actions