-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Squeeze node fails when axes is "" #21661
Comments
Specify the squeeze axis explicitly to improve compatibility with ORT: microsoft/onnxruntime#21661
Fix _log_softmax by moving the IsScalar call to the top so it can be eagerly evaluated. Also specify the squeeze axis explicitly to improve compatibility with ORT: microsoft/onnxruntime#21661 This should fix a runtime error in XGLMForCausalLM
This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details. |
cc @shubhambhokare1 this is a similar issue |
Who would be the right contact for this op? @gramalingam |
Hi, I updated the title and label based on my recollection. I believe that this is a corner case where onnxruntime does not fully support the onnx spec concerning optional trailing inputs. The ONNX spec says that for an optional trailing input like I think onnxruntime doesn't handle the second kind of input correctly. But, for now, the converter will avoid generating trailing inputs that are an empty string. So, it is not critical. But it would be helpful if onnxruntime fixes it (in case of models coming from other sources). |
Error
[ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running Squeeze node. Name:'node_Squeeze_141' Status Message: /onnxruntime_src/onnxruntime/core/providers/cuda/tensor/squeeze.cc:50 virtual onnxruntime::common::Status onnxruntime::cuda::Squeeze::ComputeInternal(onnxruntime::OpKernelContext*) const axes_tensor != nullptr was false. Axes input is null_
is raise whenSqueeze
node has a single input. According to the spec https://onnx.ai/onnx/operators/onnx__Squeeze.html,If axes is not provided, all the single dimensions will be removed from the shape. If an axis is selected with shape entry not equal to one, an error is raised.
cc @xadupre @gramalingam
The text was updated successfully, but these errors were encountered: