Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

superpoint在jetson NX平台的推理耗时问题 #33

Open
ustccxy opened this issue Jan 18, 2024 · 2 comments
Open

superpoint在jetson NX平台的推理耗时问题 #33

ustccxy opened this issue Jan 18, 2024 · 2 comments

Comments

@ustccxy
Copy link

ustccxy commented Jan 18, 2024

您好,我们在jetson NX平台上进行测试。使用develop分支构建镜像。使用realsense D435i双目相机。
开启tensonrt加速,进行superpoint前向推理时,单张图片的耗时在30ms以上,影响到了实时性。而在jetson orin上,单张推理的耗时在15ms左右,想请问你们在进行测试时的耗时情况,以及如何解决推理耗时问题。
image
image

@allegorywrite
Copy link

Hi, I have the same problem with Xavier NX. Our result is written below

Without tensorRT:

SuperPoint: 62.0ms
NetVLAD: 15.5ms
SuperGlue: 83.1ms

With tensorRT_fp16:

SuperPoint: 33.9ms
NetVLAD: 5.9ms
SuperGlue: 80.1ms

With tensorRT_int8:

SuperPoint: 28.0ms

If we believe the data above, when using a stereo vision camera, two superpoints process (left and right) are required per timestep, so the processing speed cannot exceed 1000ms / 2*30 ms = 16.7 Hz.
Is this correct? In the paper, the authors say they tested with Nvidia Xavier NX, but what were the imu and image frequencies required to get a stable odometry?
It seems that @ustccxy 's question has been unanswered for a long time, can anyone answer this question?

@allegorywrite
Copy link

@xuhao1 @Peize-Liu

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants