Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changes to run on Jetson Xavier NX. #71

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

a7ypically
Copy link
Contributor

Quick and dirty changes to allow running on Jetson Xavier NX.
I'm putting it here just as a reference for others. It is mostly just using a different base container.

@SthPhoenix
Copy link
Owner

Great work @a7ypically ! Unfortunately I have no Jetson to test it, could you create a separate dockerfile and entrypoint.sh for Jetson so I could accept your pull request without broking compatibility?

Also could you share performance metrics for Jetson Xavier NX?

PS: I have noticed you also pushed edits for Google drive downloads, I have also seen Google a bit changed downloading process, though in my test now confirmation value is always "r", is it same for you?

@a7ypically
Copy link
Contributor Author

Sure, I can create a separate dockerfile. The entrypoint.sh is actually the same. I just set it to use python3 explicitly which I assume should work fine for desktops as well?

How do I benchmark it? Do you use some script for that?

The Google drive confirmation is indeed a value of "r" if I remember correctly. A proper fix would be to first check the response content type. My quick hack may now search for a confirmation value inside a binary response which is wrong. I'll look into that when I find some time.

And thank you for your great work here.

@SthPhoenix
Copy link
Owner

SthPhoenix commented Feb 27, 2022

  1. I'm not sure if default base image have python3 alias, need to check it.

  2. You can use demo_client.py for rough estimation, also you can set logging level to debug in deploy_trt.sh and check inference timings in container logs.

  3. I was going to commit a quick fix for this, which was actually setting default value to "r" which is wrong too, but should work in case it's now default Google disk behavior.

  4. Thanks, I'm happy if this repo have helped someone in their projects.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants