StableDiffusionXL的UNet模型ONNX转OM失败

[alao556]

代码：https://gitee.com/ascend/ModelZoo-PyTorch/tree/master/ACL_PyTorch/built-in/foundation_models/stable_diffusionxl
模型权重：https://www.modelscope.cn/models/AI-ModelScope/stable-diffusion-xl-base-1.0/files
Python环境按照（1）https://github.com/Ascend/msadvisor/blob/master/auto-optimizer/README.md （2）https://gitee.com/ascend/ModelZoo-PyTorch/blob/master/ACL_PyTorch/built-in/foundation_models/stable_diffusionxl/requirements.txt 安装后最终pip list的输出如下：

Package              Version
-------------------- ------------
absl-py              1.4.0
addict               2.4.0
attrs                23.1.0
auto-optimizer       0.1.0
auto-tune            0.1.0
blosc2               2.0.0
certifi              2023.7.22
cffi                 1.15.1
charset-normalizer   3.2.0
click                8.1.7
click-aliases        1.0.4
coloredlogs          15.0.1
cycler               0.11.0
Cython               3.0.0
dataflow             0.0.1
decorator            5.1.1
diffusers            0.21.0
easydict             1.9
filelock             3.13.1
flatbuffers          23.5.26
fsspec               2023.10.0
ftfy                 6.1.3
hccl                 0.1.0
hccl-parser          0.1
huggingface-hub      0.18.0
humanfriendly        10.0
idna                 3.4
importlib-metadata   6.8.0
joblib               1.3.2
kiwisolver           1.4.4
lxml                 4.5.2
markdown-it-py       3.0.0
matplotlib           3.2.2
mdurl                0.1.2
mmcv                 2.0.1
mmengine             0.8.4
mpmath               1.3.0
msadvisor            1.0.0
msgpack              1.0.5
numexpr              2.8.5
numpy                1.25.2
onnx                 1.15.0
onnxconverter-common 1.14.0
onnxruntime          1.16.3
op-compile-tool      0.1.0
op-gen               0.1
op-test-frame        0.1
opc-tool             0.1.0
open-clip-torch      2.20.0
opencv-python        4.5.5.64
packaging            23.1
pandas               2.0.3
pathlib2             2.3.7.post1
Pillow               10.0.0
pip                  23.3.2
platformdirs         3.10.0
protobuf             3.20.2
psutil               5.9.5
py-cpuinfo           9.0.0
pycocotools          2.0.7
pycparser            2.21
Pygments             2.16.1
pyparsing            3.1.1
python-dateutil      2.8.2
pytz                 2023.3
PyYAML               6.0.1
regex                2023.10.3
requests             2.31.0
rich                 13.5.2
safetensors          0.4.1
schedule-search      0.0.1
scikit-learn         1.3.0
scipy                1.11.1
sentencepiece        0.1.99
setuptools           69.0.3
six                  1.16.0
skl2onnx             1.16.0
sklearn              0.0
sympy                1.4
tables               3.8.0
te                   0.4.0
termcolor            2.3.0
threadpoolctl        3.2.0
timm                 0.9.12
tokenizers           0.13.3
tomli                2.0.1
torch                1.13.0
torch-npu            1.11.0.post4
torchvision          0.14.1
tqdm                 4.66.1
transformers         4.26.1
typing_extensions    4.8.0
tzdata               2023.3
urllib3              2.0.4
wcwidth              0.2.13
wheel                0.32.1
yapf                 0.40.1
zipp                 3.16.2

当我执行以下命令把UNet模型从onnx转om格式：

atc --framework=5 \
--model=./unet_md.onnx \
--output=./unet \
--input_format=NCHW \
--log=error \
--optypelist_for_implmode="Gelu,Sigmoid" \
--op_select_implmode=high_performance \
--soc_version=Ascend${chip_name}

然后就报错了（clip、vae、ddim都没问题）：

ATC start working now, please wait for a moment...
ATC run failed, Please check the detail log, Try 'atc --help' for more information
E19010: No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.0/tome1/FindMax, optype [ai.onnx::11::FindMax]].
Solution: Check the version of the installation package and reinstall the package. For details, see the operator specifications.
TraceBack (most recent call last):
No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.0/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.0/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.0/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.1/tome1/FindMax, optype [ai.onnx::11::FindMax]].
No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.1/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.1/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.1/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/down_blocks.1/attentions.0/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.0/tome1/FindMax, optype [ai.onnx::11::FindMax]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.0/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.0/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.0/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.1/tome1/FindMax, optype [ai.onnx::11::FindMax]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.1/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.1/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.1/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/down_blocks.1/attentions.1/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.2/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.3/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.4/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.5/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.6/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.7/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.8/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.0/transformer_blocks.9/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.2/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.3/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.4/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.5/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.6/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.7/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.8/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/down_blocks.2/attentions.1/transformer_blocks.9/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.2/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.3/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.4/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.5/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.6/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.7/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.8/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/mid_block/attentions.0/transformer_blocks.9/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.2/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.3/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.4/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.5/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.6/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.7/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.8/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.0/transformer_blocks.9/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.2/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.3/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.4/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.5/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.6/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.7/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.8/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.1/transformer_blocks.9/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.2/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.3/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.4/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.5/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.6/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.7/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.8/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.0/attentions.2/transformer_blocks.9/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.0/tome1/FindMax, optype [ai.onnx::11::FindMax]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.0/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.0/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.0/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.1/tome1/FindMax, optype [ai.onnx::11::FindMax]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.1/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.1/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.1/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/up_blocks.1/attentions.0/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.0/tome1/FindMax, optype [ai.onnx::11::FindMax]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.0/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.0/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.0/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.1/tome1/FindMax, optype [ai.onnx::11::FindMax]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.1/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.1/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.1/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/up_blocks.1/attentions.1/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.0/tome1/FindMax, optype [ai.onnx::11::FindMax]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.0/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.0/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.0/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.1/tome1/FindMax, optype [ai.onnx::11::FindMax]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.1/tome1/TomeMerged, optype [ai.onnx::11::TomeMerged]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.1/attn1/UnpadFlashAttentionMix, optype [ai.onnx::11::UnpadFlashAttentionMix]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.1/tome1/tome/TomeUnmerge, optype [ai.onnx::11::TomeUnmerge]].
No parser is registered for Op [/up_blocks.1/attentions.2/transformer_blocks.1/ff/net.0/SliceTransGeluMul, optype [ai.onnx::11::SliceTransGeluMul]].
Model parse to graph failed, graph name:unet.[FUNC:ModelParseToGraph][FILE:onnx_parser.cc][LINE:925]
ATC model parse ret fail.[FUNC:ParseGraph][FILE:omg.cc][LINE:780]