Skip to content
CI

Add test case for unsupported input-variable reuse in multi-output pattern matcher #7367

Sign in to view logs

Add test case for unsupported input-variable reuse in multi-output pattern matcher

Add test case for unsupported input-variable reuse in multi-output pattern matcher #7367

GitHub Actions / Test Results failed Jul 16, 2024 in 0s

2 fail, 3 859 skipped, 9 373 pass in 26m 7s

    22 files   -       2      22 suites   - 2   26m 7s ⏱️ - 1h 27m 46s
13 234 tests  -     636   9 373 ✅  -  1 194   3 859 💤 +    559   2 ❌  - 1 
98 724 runs   - 194 302  42 598 ✅  - 28 347  56 116 💤  - 165 954  10 ❌  - 1 

Results for commit d80c578. ± Comparison against earlier commit 4dcf611.

Annotations

Check warning on line 0 in onnxscript.ir.serde_test.TensorProtoTensorTest

See this annotation in the file changed.

@github-actions github-actions / Test Results

9 out of 19 runs failed: test_tensor_proto_tensor_bfloat16 (onnxscript.ir.serde_test.TensorProtoTensorTest) 

artifacts/Test Results (py311-onnx-weekly-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-onnx-weekly-ubuntu-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-onnx-weekly-windows-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-torch-nightly-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-torch-nightly-ubuntu-latest)/pytest.xml [took 0s]
artifacts/Test Results (py311-torch-nightly-windows-latest)/pytest.xml [took 0s]
artifacts/Test Results (py312-torch-nightly-macos-latest)/pytest.xml [took 0s]
artifacts/Test Results (py312-torch-nightly-ubuntu-latest)/pytest.xml [took 0s]
artifacts/Test Results (py312-torch-nightly-windows-latest)/pytest.xml [took 0s]
Raw output 
AssertionError: 
Arrays are not equal

Mismatched elements: 8 / 9 (88.9%)
Max absolute difference: 49219.
Max relative difference: 97793.
 x: array([[49216, 49024, 48896, 32768,     0, 16128, 16256, 16936, 16384]],
      dtype=(numpy.uint16, [('bfloat16', '<u2')]))
 y: array([[-3, -1, -0.5, -0, 0, 0.5, 1, 42, 2]], dtype=bfloat16)
onnxscript/ir/serde_test.py:106: in test_tensor_proto_tensor_bfloat16
    np.testing.assert_array_equal(array_from_raw_data, expected_array)
/opt/hostedtoolcache/Python/3.11.9/x64/lib/python3.11/contextlib.py:81: in inner
    return func(*args, **kwds)
E   AssertionError: 
E   Arrays are not equal
E   
E   Mismatched elements: 8 / 9 (88.9%)
E   Max absolute difference: 49219.
E   Max relative difference: 97793.
E    x: array([[49216, 49024, 48896, 32768,     0, 16128, 16256, 16936, 16384]],
E         dtype=(numpy.uint16, [('bfloat16', '<u2')]))
E    y: array([[-3, -1, -0.5, -0, 0, 0.5, 1, 42, 2]], dtype=bfloat16)

Check warning on line 0 in onnxscript.backend.onnx_export_test.TestOnnxBackEnd

See this annotation in the file changed.

@github-actions github-actions / Test Results

1 out of 3 runs failed: test_export2python_produces_correct_onnx_script_model_0908_test_reduce_sum_empty_set (onnxscript.backend.onnx_export_test.TestOnnxBackEnd) 

artifacts/Test Results (py312-torch-nightly-windows-latest)/pytest.xml [took 0s]
Raw output 
AssertionError: Unable to import 'tests.onnx_backend_test_code.test_reduce_sum_empty_set' (e=No module named 'tests.onnx_backend_test_code.test_reduce_sum_empty_set') (file: 'D:\\a\\onnxscript\\onnxscript\\tests\\onnx_backend_test_code\\test_reduce_sum_empty_set.py', absolute path: 'D:\\a\\onnxscript\\onnxscript\\tests\\onnx_backend_test_code\\test_reduce_sum_empty_set.py', current folder: D:\a\onnxscript\onnxscript
---- CONTENT --
import numpy
from onnx import TensorProto
from onnx.helper import make_tensor
from onnxscript import script, external_tensor
from onnxscript.values import Opset
from onnxscript.onnx_types import FLOAT, INT64
from onnxscript.onnx_opset import opset13

@script()
def bck_test_reduce_sum_empty_set(data: FLOAT[2,0,4], axes: INT64[1]) -> (FLOAT[2,1,4]):
    reduced = opset13.ReduceSum(data, axes, keepdims=1)
    return reduced
onnxscript\backend\onnx_export_test.py:133: in extract_functions
    mod = importlib.import_module(import_name)
C:\hostedtoolcache\windows\Python\3.12.4\x64\Lib\importlib\__init__.py:90: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
E   ModuleNotFoundError: No module named 'tests.onnx_backend_test_code.test_reduce_sum_empty_set'

The above exception was the direct cause of the following exception:
.nox\test_torch_nightly\Lib\site-packages\parameterized\parameterized.py:620: in standalone_func
    return func(*(a + p.args), **p.kwargs, **kw)
onnxscript\backend\onnx_export_test.py:267: in test_export2python_produces_correct_onnx_script_model
    functions = extract_functions(backend_test.name, code, self.test_folder)
onnxscript\backend\onnx_export_test.py:135: in extract_functions
    raise AssertionError(
E   AssertionError: Unable to import 'tests.onnx_backend_test_code.test_reduce_sum_empty_set' (e=No module named 'tests.onnx_backend_test_code.test_reduce_sum_empty_set') (file: 'D:\\a\\onnxscript\\onnxscript\\tests\\onnx_backend_test_code\\test_reduce_sum_empty_set.py', absolute path: 'D:\\a\\onnxscript\\onnxscript\\tests\\onnx_backend_test_code\\test_reduce_sum_empty_set.py', current folder: D:\a\onnxscript\onnxscript
E   ---- CONTENT --
E   import numpy
E   from onnx import TensorProto
E   from onnx.helper import make_tensor
E   from onnxscript import script, external_tensor
E   from onnxscript.values import Opset
E   from onnxscript.onnx_types import FLOAT, INT64
E   from onnxscript.onnx_opset import opset13
E   
E   @script()
E   def bck_test_reduce_sum_empty_set(data: FLOAT[2,0,4], axes: INT64[1]) -> (FLOAT[2,1,4]):
E       reduced = opset13.ReduceSum(data, axes, keepdims=1)
E       return reduced
View more details on GitHub Actions