Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

表情识别demo 部署失败 #318

Open
luoyangustc opened this issue Nov 8, 2022 · 8 comments
Open

表情识别demo 部署失败 #318

luoyangustc opened this issue Nov 8, 2022 · 8 comments

Comments

@luoyangustc
Copy link

按照文档https://modelbox-ai.com/modelbox-book/cases/emotion-detection.html进行了表情识别的样例的实践,在开发环境中通过打包应用,生产了一个deb安装包和一个tar包;然后将deb文件和tar包文件拷贝到modelbox/modelbox-runtime-libtorch_1.9.1-cuda_10.2-ubuntu-x86_64:latest此镜像启动的容器内进行部署,部署步骤如下:
1、dpkg -i modelbox-application-1.0.0-Linux-emotion.deb
2、tar -xzvf modelbox-application-1.0.0-Linux.tar.gz
3、modelbox-tool -verbose INFO flow -run /opt/modelbox/application/emotion/graph/emotion.toml
结果在执行3时报错:
[2022-11-08 06:29:15,497][ INFO][ flow.cc:97 ] run flow /opt/modelbox/application/emotion/graph/emotion.toml
[2022-11-08 06:29:15,500][ INFO][ driver.cc:152 ] wait for subprocess 67 process finished
[2022-11-08 06:29:15,974][ INFO][ driver.cc:61 ] scan process log:
[2022-11-08 06:29:15.500][ INFO][ driver.cc:889 ] Scan dir: /opt/modelbox/application/emotion/flowunit
[2022-11-08 06:29:15.500][ INFO][ driver.cc:889 ] Scan dir: /usr/local/lib
[2022-11-08 06:29:15.506][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-common-cpu-iam_auth.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-common-cpu-iam_auth.so: undefined symbol: DriverDescription
[2022-11-08 06:29:15.509][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0: undefined symbol: DriverDescription
[2022-11-08 06:29:15.510][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0: undefined symbol: DriverDescription
[2022-11-08 06:29:15.560][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-unit-cpu-obs_client.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-unit-cpu-obs_client.so: undefined symbol: DriverDescription
[2022-11-08 06:29:15.576][ WARN][ driver.cc:1097] /usr/local/lib/libmodelbox-unit-cpu-python.so.1.0.0 : dlopen failed, libpython3.7m.so.1.0: cannot open shared object file: No such file or directory
[2022-11-08 06:29:15,976][ INFO][ driver.cc:764 ] Gather scan info success, drivers count 45
[2022-11-08 06:29:15,976][ INFO][ driver.cc:1010] begin scan virtual drivers
[2022-11-08 06:29:15,978][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/face_detect/face_detect.toml success
[2022-11-08 06:29:15,981][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/emotion_infer/emotion_infer.toml success
[2022-11-08 06:29:15,985][ WARN][ driver.cc:1045] virtual driver init failed, code: Not found, errmsg: can not find python flowunit
[2022-11-08 06:29:15,986][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/draw_emotion/draw_emotion.toml success
[2022-11-08 06:29:15,987][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/face_post/face_post.toml success
[2022-11-08 06:29:15,988][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/collapse_emotion/collapse_emotion.toml success
[2022-11-08 06:29:15,989][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/custom_resize/custom_resize.toml success
[2022-11-08 06:29:15,990][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /opt/modelbox/application/emotion/flowunit/expand_box/expand_box.toml success
[2022-11-08 06:29:15,999][ INFO][ driver.cc:1012] end scan virtual drivers
[2022-11-08 06:29:16,346][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 06:29:16,346][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 06:29:16,346][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 06:29:16,347][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 06:29:16,347][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 06:29:16,347][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 06:29:16,348][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 06:29:16,348][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 06:29:16,348][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 06:29:16,348][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 06:29:16,348][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 06:29:16,348][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 06:29:16,349][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 06:29:16,349][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 06:29:16,349][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 06:29:16,352][ INFO][ graph_manager.cc:353 ] graph.format : graphviz
[2022-11-08 06:29:16,353][ INFO][ graph.cc:116 ] Build graph name:emotion_detection, id:faa75409-0052-417e-856c-81735f04d805
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : collapse_emotion
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : confidence
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : predicts
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : custom_resize
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : draw_emotion
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_emotion
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_face
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : emotion_infer
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : input
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : confidence
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : predicts
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : expand_box
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : roi_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_detect
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : input
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_cls
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_conf
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_loc
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_mean
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_normalize
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_post
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_cls
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_conf
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_loc
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : has_face
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : no_face
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_resize
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : face_transpose
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : image_transpose
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_image
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : mean
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : normalize
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : video_input
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_video_url
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : videodecoder
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_video_packet
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_video_frame
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : videodemuxer
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_video_url
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:271 ] output port : out_video_packet
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:260 ] node name : videoencoder
[2022-11-08 06:29:16,353][ INFO][ graph_manager.cc:265 ] input port : in_video_frame
[2022-11-08 06:29:16,353][ INFO][ graph.cc:641 ] begin build node collapse_emotion
[2022-11-08 06:29:16,354][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 06:29:16,354][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 06:29:16,354][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 06:29:16,354][ WARN][flowunit_manager.cc:342 ] CreateFlowUnit: collapse_emotion failed, code: Not found, errmsg: not found flowunit collapse_emotion
[2022-11-08 06:29:16,354][ERROR][ graph.cc:644 ] code: Not found, errmsg: create flowunit 'collapse_emotion' failed.
[2022-11-08 06:29:16,354][ERROR][ flow.cc:537 ] build graph failed, Not found, build graph failed, please check graph config. -> create flowunit 'collapse_emotion' failed. -> not found flowunit collapse_emotion
[2022-11-08 06:29:16,354][ERROR][ flow.cc:106 ] build flow failed, Not found, build graph failed, please check graph config. -> create flowunit 'collapse_emotion' failed. -> not found flowunit collapse_emotion

想知道是什么原因,该如何成功部署这个服务?谢谢!

@luoyangustc
Copy link
Author

另我在editor的UI界面 点击调试:
image
body 和 url 该填什么,感觉模版没有渲染出来

@tau233
Copy link
Contributor

tau233 commented Nov 8, 2022

报错说明:
这个报错是说collapse_emotion功能单元找不到,可以检查下collapse_emotion.toml和对应的python代码,路径、类名等是否匹配等

调试说明:
表情识别demo用的是开发镜像里的测试视频文件,在graph/emotion.toml配置的输入输出:
video_input[type=flowunit, flowunit=video_input, device=cpu, source_url="/opt/modelbox/demo/video/emotion_test_video.mp4"]
videoencoder[type=flowunit, flowunit=video_encoder, device=cpu, encoder=mpeg4, format=mp4, default_dest_url="/tmp/emotion_detection_result.mp4"]
可以先在开发镜像中调试运行。由于runtime镜像中没有测试视频文件,用该配置部署到runtime镜像中无法正确运行

其他的建议:
deb安装包和tar包只用安装一个就可以了

@pymumu
Copy link
Contributor

pymumu commented Nov 8, 2022

这个log显示加载python相关的动态库失效了

[2022-11-08 06:29:15.576][ WARN][ driver.cc:1097] /usr/local/lib/libmodelbox-unit-cpu-python.so.1.0.0 : dlopen failed, libpython3.7m.so.1.0: cannot open shared object file: No such file or directory

确认下镜像是不是用的我们发布的,还有里面的modelbox程序是否有自己替换过?

@luoyangustc
Copy link
Author

这个log显示加载python相关的动态库失效了

[2022-11-08 06:29:15.576][ WARN][ driver.cc:1097] /usr/local/lib/libmodelbox-unit-cpu-python.so.1.0.0 : dlopen failed, libpython3.7m.so.1.0: cannot open shared object file: No such file or directory

确认下镜像是不是用的我们发布的,还有里面的modelbox程序是否有自己替换过?

确认拉取的是你们官方镜像,
image, 没有改过modelbox的程序!

@luoyangustc
Copy link
Author

报错说明: 这个报错是说collapse_emotion功能单元找不到,可以检查下collapse_emotion.toml和对应的python代码,路径、类名等是否匹配等
这个是匹配的;
调试说明: 表情识别demo用的是开发镜像里的测试视频文件,在graph/emotion.toml配置的输入输出: video_input[type=flowunit, flowunit=video_input, device=cpu, source_url="/opt/modelbox/demo/video/emotion_test_video.mp4"] videoencoder[type=flowunit, flowunit=video_encoder, device=cpu, encoder=mpeg4, format=mp4, default_dest_url="/tmp/emotion_detection_result.mp4"] 可以先在开发镜像中调试运行。由于runtime镜像中没有测试视频文件,用该配置部署到runtime镜像中无法正确运行
嗯嗯,但是我在看法镜像的/tmp文件夹下没有发现emotion_detection_result.mp4文件,UI任务管理里
image
是任务正在执行中,这个不是一个http的web服务,这个执行中的状态代表什么意思,
2、通过UII创建项目时,会在项目根目录里也有modexbox和modelbox-manager的二进制,这个与/usr/local/usr/local/bin 目录下的有什么区别?我看md5不一样。
其他的建议: deb安装包和tar包只用安装一个就可以了
OK

@tau233
Copy link
Contributor

tau233 commented Nov 8, 2022

1、运行中表示modelbox进程还在运行,任务可能已经结束,详细情况可以查看/var/log/modelbox/目录下的日志
2、项目根目录下的是脚本文件,会调用/usr/local/bin下的二进制

@luoyangustc
Copy link
Author

1、应该看项目目录下的日志文件吧,/var 下是manager的日志
2、我自己modelbox-tool flow -run confile 是可以完成表情识别的任务,但是通过U I点击运行后,发现任务失败,看日志
[2022-11-08 13:08:45,289][ INFO][ editor_plugin.cc:661 ] template_dir:/usr/local/share/modelbox/project-template/project
[2022-11-08 13:08:45,295][ INFO][ driver.cc:152 ] wait for subprocess 1948 process finished
[2022-11-08 13:08:45,779][ INFO][ driver.cc:61 ] scan process log:
[2022-11-08 13:08:45.297][ INFO][ driver.cc:889 ] Scan dir: /opt/modelbox/application/emotion/flowunit
[2022-11-08 13:08:45.297][ WARN][ driver.cc:892 ] scan /opt/modelbox/application/emotion/flowunit failed, Fault, lstat /opt/modelbox/application/emotion/flowunit failed, No such file or directory
[2022-11-08 13:08:45.297][ INFO][ driver.cc:889 ] Scan dir: /home/emotion/src/flowunit
[2022-11-08 13:08:45.298][ INFO][ driver.cc:889 ] Scan dir: /usr/local/lib
[2022-11-08 13:08:45.304][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-common-cpu-iam_auth.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-common-cpu-iam_auth.so: undefined symbol: DriverDescription
[2022-11-08 13:08:45.306][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0: undefined symbol: DriverDescription
[2022-11-08 13:08:45.307][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0: undefined symbol: DriverDescription
[2022-11-08 13:08:45.356][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-unit-cpu-obs_client.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-unit-cpu-obs_client.so: undefined symbol: DriverDescription
[2022-11-08 13:08:45,781][ INFO][ driver.cc:764 ] Gather scan info success, drivers count 46
[2022-11-08 13:08:45,781][ INFO][ driver.cc:1010] begin scan virtual drivers
[2022-11-08 13:08:45,781][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: list directory: /opt/modelbox/application/emotion/flowunit/.toml failed.
[2022-11-08 13:08:45,782][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /home/emotion/src/flowunit/face_detect/face_detect.toml success
[2022-11-08 13:08:45,785][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /home/emotion/src/flowunit/emotion_infer/emotion_infer.toml success
[2022-11-08 13:08:45,789][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: No such file or directory
[2022-11-08 13:08:45,791][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/draw_emotion/draw_emotion.toml success
[2022-11-08 13:08:45,792][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/face_post/face_post.toml success
[2022-11-08 13:08:45,793][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/collapse_emotion/collapse_emotion.toml success
[2022-11-08 13:08:45,794][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/custom_resize/custom_resize.toml success
[2022-11-08 13:08:45,795][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/expand_box/expand_box.toml success
[2022-11-08 13:08:45,797][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: list directory: /opt/modelbox/application/emotion/flowunit/
.toml failed.
[2022-11-08 13:08:45,804][ INFO][ driver.cc:1012] end scan virtual drivers
[2022-11-08 13:08:46,268][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:46,268][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:46,268][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:46,269][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:46,269][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:46,269][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:46,270][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:46,270][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:46,270][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:46,270][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:46,270][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:46,270][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:46,271][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:46,271][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:46,271][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:46,289][ INFO][ editor_plugin.cc:405 ] loading project: /home/emotion
[2022-11-08 13:08:46,289][ INFO][ editor_plugin.cc:573 ] exec: /usr/local/bin/modelbox-tool template -project -getname "/home/emotion"
[2022-11-08 13:08:46,373][ INFO][ editor_plugin.cc:405 ] loading project: /home/emotion
[2022-11-08 13:08:46,373][ INFO][ editor_plugin.cc:573 ] exec: /usr/local/bin/modelbox-tool template -project -getname "/home/emotion"
[2022-11-08 13:08:47,492][ERROR][ driver.cc:836 ] lstat /opt/modelbox/application/emotion/flowunit failed, errno:No such file or directory
[2022-11-08 13:08:47,495][ INFO][ driver.cc:152 ] wait for subprocess 1960 process finished
[2022-11-08 13:08:47,687][ INFO][ driver.cc:61 ] scan process log:
[2022-11-08 13:08:47.497][ INFO][ driver.cc:889 ] Scan dir: /opt/modelbox/application/emotion/flowunit
[2022-11-08 13:08:47.497][ WARN][ driver.cc:892 ] scan /opt/modelbox/application/emotion/flowunit failed, Fault, lstat /opt/modelbox/application/emotion/flowunit failed, No such file or directory
[2022-11-08 13:08:47.498][ INFO][ driver.cc:889 ] Scan dir: /home/emotion/src/flowunit
[2022-11-08 13:08:47.498][ INFO][ driver.cc:889 ] Scan dir: /usr/local/lib
[2022-11-08 13:08:47.502][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-common-cpu-iam_auth.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-common-cpu-iam_auth.so: undefined symbol: DriverDescription
[2022-11-08 13:08:47.504][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-filerequester.so.1.0.0: undefined symbol: DriverDescription
[2022-11-08 13:08:47.505][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0 : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-drivers-common-fuse.so.1.0.0: undefined symbol: DriverDescription
[2022-11-08 13:08:47.552][ WARN][ driver.cc:1112] /usr/local/lib/libmodelbox-unit-cpu-obs_client.so : dlsym DriverDescription failed, /usr/local/lib/libmodelbox-unit-cpu-obs_client.so: undefined symbol: DriverDescription
[2022-11-08 13:08:47,688][ INFO][ driver.cc:764 ] Gather scan info success, drivers count 46
[2022-11-08 13:08:47,688][ INFO][ driver.cc:1010] begin scan virtual drivers
[2022-11-08 13:08:47,688][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: list directory: /opt/modelbox/application/emotion/flowunit/.toml failed.
[2022-11-08 13:08:47,690][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /home/emotion/src/flowunit/face_detect/face_detect.toml success
[2022-11-08 13:08:47,692][ INFO][virtualdriver_inference.cc:80 ] Add virtual driver /home/emotion/src/flowunit/emotion_infer/emotion_infer.toml success
[2022-11-08 13:08:47,696][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: No such file or directory
[2022-11-08 13:08:47,697][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/draw_emotion/draw_emotion.toml success
[2022-11-08 13:08:47,698][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/face_post/face_post.toml success
[2022-11-08 13:08:47,699][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/collapse_emotion/collapse_emotion.toml success
[2022-11-08 13:08:47,700][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/custom_resize/custom_resize.toml success
[2022-11-08 13:08:47,701][ INFO][virtualdriver_python.cc:86 ] Add virtual driver /home/emotion/src/flowunit/expand_box/expand_box.toml success
[2022-11-08 13:08:47,703][ WARN][virtual_driver.cc:44 ] Scan /opt/modelbox/application/emotion/flowunit failed, code: Not found, errmsg: list directory: /opt/modelbox/application/emotion/flowunit/
.toml failed.
[2022-11-08 13:08:47,710][ INFO][ driver.cc:1012] end scan virtual drivers
[2022-11-08 13:08:47,777][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:47,777][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:47,777][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:47,777][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:47,777][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:47,777][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:47,778][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:47,778][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:47,778][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:47,779][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:47,779][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:47,779][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:47,779][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:47,780][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:47,780][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:47,782][ INFO][ graph_manager.cc:353 ] graph.format : graphviz
[2022-11-08 13:08:47,783][ INFO][ graph.cc:116 ] Build graph name:emotion_detection, id:70e63e76-37b9-4ec8-a777-9a5d8e18438f
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : collapse_emotion
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : confidence
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : predicts
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : custom_resize
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : draw_emotion
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_emotion
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_face
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : emotion_infer
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : input
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : confidence
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : predicts
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : expand_box
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : roi_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_detect
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : input
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_cls
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_conf
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_loc
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_mean
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_normalize
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_post
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_cls
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_conf
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_loc
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : has_face
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : no_face
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_resize
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : face_transpose
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : image_transpose
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_image
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : mean
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : normalize
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_data
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : video_input
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_video_url
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : videodecoder
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_video_packet
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_video_frame
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : videodemuxer
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_video_url
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:271 ] output port : out_video_packet
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:260 ] node name : videoencoder
[2022-11-08 13:08:47,783][ INFO][ graph_manager.cc:265 ] input port : in_video_frame
[2022-11-08 13:08:47,783][ INFO][ graph.cc:641 ] begin build node collapse_emotion
[2022-11-08 13:08:47,784][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:47,784][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:47,784][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:47,784][ INFO][ graph.cc:647 ] build node collapse_emotion success
[2022-11-08 13:08:47,784][ INFO][ graph.cc:641 ] begin build node custom_resize
[2022-11-08 13:08:47,785][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:47,785][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:47,785][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:47,785][ INFO][ graph.cc:647 ] build node custom_resize success
[2022-11-08 13:08:47,785][ INFO][ graph.cc:641 ] begin build node draw_emotion
[2022-11-08 13:08:47,786][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:08:47,786][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:08:47,786][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:08:47,786][ INFO][ graph.cc:647 ] build node draw_emotion success
[2022-11-08 13:08:47,786][ INFO][ graph.cc:641 ] begin build node emotion_infer
[2022-11-08 13:09:03,422][ INFO][ graph.cc:647 ] build node emotion_infer success
[2022-11-08 13:09:03,422][ INFO][ graph.cc:641 ] begin build node expand_box
[2022-11-08 13:09:03,423][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:09:03,423][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:09:03,423][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:09:03,423][ INFO][ graph.cc:647 ] build node expand_box success
[2022-11-08 13:09:03,423][ INFO][ graph.cc:641 ] begin build node face_detect
[2022-11-08 13:09:03,426][ INFO][ graph.cc:647 ] build node face_detect success
[2022-11-08 13:09:03,426][ INFO][ graph.cc:641 ] begin build node face_mean
[2022-11-08 13:09:03,426][ INFO][ graph.cc:647 ] build node face_mean success
[2022-11-08 13:09:03,426][ INFO][ graph.cc:641 ] begin build node face_normalize
[2022-11-08 13:09:03,426][ INFO][ graph.cc:647 ] build node face_normalize success
[2022-11-08 13:09:03,426][ INFO][ graph.cc:641 ] begin build node face_post
[2022-11-08 13:09:03,427][ WARN][virtualdriver_python.cc:308 ] the key group type is empty, so classify it into Undefined.
[2022-11-08 13:09:03,427][ WARN][ flowunit.cc:515 ] is not match, you can use a-z, A-Z, 1-9, _ and uppercase the first character.
[2022-11-08 13:09:03,427][ WARN][ flowunit.cc:396 ] check group type failed , your group_type is , the right group_type is a or a/b , for instance input or input/http.
[2022-11-08 13:09:03,427][ INFO][ graph.cc:647 ] build node face_post success
[2022-11-08 13:09:03,427][ INFO][ graph.cc:641 ] begin build node face_resize
[2022-11-08 13:09:03,427][ INFO][ graph.cc:647 ] build node face_resize success
[2022-11-08 13:09:03,427][ INFO][ graph.cc:641 ] begin build node face_transpose
[2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node face_transpose success
[2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node image_transpose
[2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node image_transpose success
[2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node mean
[2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node mean success
[2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node normalize
[2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node normalize success
[2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node video_input
[2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node video_input success
[2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node videodecoder
[2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node videodecoder success
[2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node videodemuxer
[2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node videodemuxer success
[2022-11-08 13:09:03,428][ INFO][ graph.cc:641 ] begin build node videoencoder
[2022-11-08 13:09:03,428][ INFO][ graph.cc:647 ] build node videoencoder success
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, collapse_emotion:out_data -> draw_emotion:in_emotion
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, custom_resize:out_image -> image_transpose:in_image
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, draw_emotion:out_data -> videoencoder:in_video_frame
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, emotion_infer:confidence -> collapse_emotion:confidence
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, emotion_infer:predicts -> collapse_emotion:predicts
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, expand_box:roi_image -> face_resize:in_image
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_detect:out_cls -> face_post:in_cls
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_detect:out_conf -> face_post:in_conf
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_detect:out_loc -> face_post:in_loc
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_mean:out_data -> face_normalize:in_data
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_normalize:out_data -> emotion_infer:input
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_post:has_face -> draw_emotion:in_face
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_post:has_face -> expand_box:in_data
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_post:no_face -> videoencoder:in_video_frame
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_resize:out_image -> face_transpose:in_image
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, face_transpose:out_image -> face_mean:in_data
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, image_transpose:out_image -> mean:in_data
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, mean:out_data -> normalize:in_data
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, normalize:out_data -> face_detect:input
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, video_input:out_video_url -> videodemuxer:in_video_url
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, videodecoder:out_video_frame -> custom_resize:in_image
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, videodecoder:out_video_frame -> face_post:in_image
[2022-11-08 13:09:03,428][ INFO][ graph.cc:368 ] add link, videodemuxer:out_video_packet -> videodecoder:in_video_packet
[2022-11-08 13:09:03,429][ INFO][flowunit_group.cc:406 ] node: face_mean get batch size is 8
[2022-11-08 13:09:03,429][ INFO][flowunit_group.cc:406 ] node: face_normalize get batch size is 8
[2022-11-08 13:09:03,429][ INFO][flowunit_group.cc:406 ] node: face_resize get batch size is 8
[2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: face_transpose get batch size is 8
[2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: image_transpose get batch size is 8
[2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: mean get batch size is 8
[2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: normalize get batch size is 8
[2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: videodecoder get batch size is 1
[2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: videodemuxer get batch size is 1
[2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: video_input get batch size is 8
[2022-11-08 13:09:03,430][ INFO][flowunit_group.cc:406 ] node: videoencoder get batch size is 1
[2022-11-08 13:09:03,431][ INFO][session_context.cc:40 ] session context start se id:11520f80-cc37-4c49-9cf3-3784b7440ca4
[2022-11-08 13:09:03,957][ INFO][flowunit_group.cc:406 ] node: collapse_emotion get batch size is 1
[2022-11-08 13:09:04,009][ INFO][flowunit_group.cc:406 ] node: custom_resize get batch size is 1
[2022-11-08 13:09:04,010][ INFO][flowunit_group.cc:406 ] node: draw_emotion get batch size is 1
[2022-11-08 13:09:04,011][ INFO][flowunit_group.cc:406 ] node: expand_box get batch size is 1
[2022-11-08 13:09:04,013][ INFO][flowunit_group.cc:406 ] node: face_post get batch size is 1
[2022-11-08 13:09:04,431][ INFO][flowunit_group.cc:406 ] node: emotion_infer get batch size is 1
[2022-11-08 13:09:04,558][ INFO][flowunit_group.cc:406 ] node: face_detect get batch size is 8
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: collapse_emotion #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: custom_resize #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: draw_emotion #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: emotion_infer #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: expand_box #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_detect #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_mean #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_normalize #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_post #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_resize #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: face_transpose #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: image_transpose #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: mean #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: normalize #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: video_input #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: videodecoder #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: videodemuxer #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:880 ] node: videoencoder #0
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 0, video_input
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 1, videodemuxer
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 2, videodecoder
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 3, custom_resize
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 4, image_transpose
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 5, mean
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 6, normalize
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 7, face_detect
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 8, face_post
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 9, expand_box
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 10, face_resize
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 11, face_transpose
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 12, face_mean
[2022-11-08 13:09:04,559][ INFO][ graph.cc:1084] topo index: 13, face_normalize
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1084] topo index: 14, emotion_infer
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1084] topo index: 15, collapse_emotion
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1084] topo index: 16, draw_emotion
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1084] topo index: 17, videoencoder
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: videodemuxer port: in_video_url priority: 1
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: videodecoder port: in_video_packet priority: 2
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: custom_resize port: in_image priority: 3
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: image_transpose port: in_image priority: 4
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: mean port: in_data priority: 5
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: normalize port: in_data priority: 6
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_detect port: input priority: 7
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_post port: in_cls priority: 8
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_post port: in_conf priority: 8
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_post port: in_image priority: 8
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_post port: in_loc priority: 8
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: expand_box port: in_data priority: 9
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_resize port: in_image priority: 10
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_transpose port: in_image priority: 11
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_mean port: in_data priority: 12
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: face_normalize port: in_data priority: 13
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: emotion_infer port: input priority: 14
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: collapse_emotion port: confidence priority: 15
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: collapse_emotion port: predicts priority: 15
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: draw_emotion port: in_emotion priority: 16
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: draw_emotion port: in_face priority: 16
[2022-11-08 13:09:04,560][ INFO][ graph.cc:901 ] set priority. node: videoencoder port: in_video_frame priority: 17
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, expand_box:roi_image -> face_resize:in_image
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_resize:out_image -> face_transpose:in_image
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, custom_resize:out_image -> image_transpose:in_image
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, image_transpose:out_image -> mean:in_data
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, mean:out_data -> normalize:in_data
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, videodemuxer:out_video_packet -> videodecoder:in_video_packet
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, video_input:out_video_url -> videodemuxer:in_video_url
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_post:no_face -> videoencoder:in_video_frame
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, draw_emotion:out_data -> videoencoder:in_video_frame
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_transpose:out_image -> face_mean:in_data
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_detect:out_conf -> face_post:in_conf
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, videodecoder:out_video_frame -> face_post:in_image
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, normalize:out_data -> face_detect:input
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_detect:out_loc -> face_post:in_loc
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_detect:out_cls -> face_post:in_cls
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_mean:out_data -> face_normalize:in_data
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_post:has_face -> expand_box:in_data
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, emotion_infer:predicts -> collapse_emotion:predicts
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, emotion_infer:confidence -> collapse_emotion:confidence
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, videodecoder:out_video_frame -> custom_resize:in_image
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, collapse_emotion:out_data -> draw_emotion:in_emotion
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_post:has_face -> draw_emotion:in_face
[2022-11-08 13:09:04,560][ INFO][ graph.cc:1105] port connect, face_normalize:out_data -> emotion_infer:input
[2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: draw_emotion, key: match_node, value: face_post
[2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: collapse_emotion, key: match_node, value: expand_box
[2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: videoencoder, key: match_node, value: face_post
[2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: face_post, key: match_node, value: videodecoder
[2022-11-08 13:09:04,560][ INFO][ graph_checker.cc:786 ] node: expand_box, key: match_node, value: face_post
[2022-11-08 13:09:04,560][ INFO][flow_scheduler.cc:93 ] init scheduler with 48 threads, max 1536
[2022-11-08 13:09:04,561][ INFO][ editor_plugin.cc:661 ] template_dir:/usr/local/share/modelbox/project-template/project
[2022-11-08 13:09:04,561][ INFO][ match_stream.cc:529 ] node video_input, port External_Port, inherit backward level 0
[2022-11-08 13:09:04,563][ INFO][ match_stream.cc:529 ] node videodemuxer, port in_video_url, inherit backward level 0
[2022-11-08 13:09:04,567][ INFO][ ffmpeg_reader.cc:112 ] Source url:@DEMO_VIDEO_DIR@/emotion_test_video.mp4, reconnect:true, rw_timeout:30s
[2022-11-08 13:09:04,567][ERROR][ ffmpeg_reader.cc:72 ] avformat open input[@DEMO_VIDEO_DIR@/emotion_test_video.mp4] failed, err No such file or directory
[2022-11-08 13:09:04,567][ INFO][video_demuxer_flowunit.cc:272 ] Open reader falied, set DEMUX_STATUS failed
[2022-11-08 13:09:04,567][ INFO][video_demuxer_flowunit.cc:244 ] failed init Demuxer
[2022-11-08 13:09:04,567][ INFO][flowunit_group.cc:95 ] flowunit video_demuxer data pre return: Fault
[2022-11-08 13:09:04,568][ INFO][ node.cc:757 ] node: videodemuxer, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished
[2022-11-08 13:09:04,568][ INFO][ match_stream.cc:529 ] node videodecoder, port in_video_packet, inherit backward level 0
[2022-11-08 13:09:04,568][ INFO][video_decoder_flowunit.cc:251 ] Video Decode Start
[2022-11-08 13:09:04,568][ INFO][nvcodec_video_decoder.cc:125 ] Init decode in gpu 0
[2022-11-08 13:09:04,568][ERROR][nvcodec_video_decoder.cc:235 ] ffmpeg code id[0] for nvcodec is not supported
[2022-11-08 13:09:04,568][ERROR][video_decoder_flowunit.cc:273 ] Video decoder init failed
[2022-11-08 13:09:04,568][ INFO][flowunit_group.cc:95 ] flowunit video_decoder data pre return: Fault
[2022-11-08 13:09:04,568][ INFO][ node.cc:757 ] node: videodecoder, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished
[2022-11-08 13:09:04,569][ INFO][ match_stream.cc:529 ] node custom_resize, port in_image, inherit backward level 0
[2022-11-08 13:09:04,569][ INFO][ node.cc:757 ] node: custom_resize, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished
[2022-11-08 13:09:04,569][ INFO][ match_stream.cc:529 ] node image_transpose, port in_image, inherit backward level 0
[2022-11-08 13:09:04,569][ INFO][ match_stream.cc:529 ] node mean, port in_data, inherit backward level 0
[2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node normalize, port in_data, inherit backward level 0
[2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_detect, port input, inherit backward level 0
[2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_post, port in_loc, inherit backward level 0
[2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_post, port in_image, inherit backward level 0
[2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_post, port in_cls, inherit backward level 0
[2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node face_post, port in_conf, inherit backward level 0
[2022-11-08 13:09:04,570][ INFO][ match_stream.cc:529 ] node videoencoder, port in_video_frame, inherit backward level 0
[2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node expand_box, port in_data, inherit backward level 0
[2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node face_resize, port in_image, inherit backward level 0
[2022-11-08 13:09:04,571][ INFO][ node.cc:757 ] node: expand_box, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished
[2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node face_transpose, port in_image, inherit backward level 0
[2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node face_mean, port in_data, inherit backward level 0
[2022-11-08 13:09:04,571][ INFO][ match_stream.cc:529 ] node face_normalize, port in_data, inherit backward level 0
[2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node emotion_infer, port input, inherit backward level 0
[2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node collapse_emotion, port predicts, inherit backward level 0
[2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node collapse_emotion, port confidence, inherit backward level 0
[2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node draw_emotion, port in_face, inherit backward level 0
[2022-11-08 13:09:04,572][ INFO][ match_stream.cc:529 ] node draw_emotion, port in_emotion, inherit backward level 0
[2022-11-08 13:09:04,573][ INFO][ node.cc:757 ] node: collapse_emotion, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished
[2022-11-08 13:09:04,573][ WARN][video_encoder_flowunit.cc:299 ] Input meta [dest_url] should be set in port [in_video_frame] for each stream, Use default_dest_url in config is only for debug
[2022-11-08 13:09:04,573][ERROR][video_encoder_flowunit.cc:226 ] Input [frame_info] is empty
[2022-11-08 13:09:04,573][ INFO][flowunit_group.cc:95 ] flowunit video_encoder data pre return: Fault
[2022-11-08 13:09:04,573][ INFO][ node.cc:757 ] node: draw_emotion, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished
[2022-11-08 13:09:04,573][ INFO][ node.cc:757 ] node: videoencoder, sess id: 11520f80-cc37-4c49-9cf3-3784b7440ca4, data ctx finished
[2022-11-08 13:09:04,573][ INFO][ session.cc:121 ] session 11520f80-cc37-4c49-9cf3-3784b7440ca4 is over, running session count 0
[2022-11-08 13:09:04,573][ INFO][session_context.cc:44 ] session context finish se id:11520f80-cc37-4c49-9cf3-3784b7440ca4
和toml文件,
可能是
image
这个source_url 的地址找不到,但是我改成/opt下的测试文件,再次点击运行,好像toml文件又被改成上图的地址了,这个是我哪儿使用不对么?

@tau233
Copy link
Contributor

tau233 commented Nov 10, 2022

当前UI前端和后端同步有点问题,下个版本会解决。当前可以通过moelbox-tool命令行执行

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants