Skip to content

Commit

Permalink
Merge pull request #974 from anarkiwi/doc2
Browse files Browse the repository at this point in the history
Orin docs.
  • Loading branch information
anarkiwi authored Nov 16, 2023
2 parents e54dde3 + b4e07d0 commit df3dd4a
Showing 1 changed file with 11 additions and 0 deletions.
11 changes: 11 additions & 0 deletions docker/Dockerfile.orin-torchserve
Original file line number Diff line number Diff line change
Expand Up @@ -7,3 +7,14 @@ RUN /usr/local/bin/torchserve --help
COPY torchserve/config.properties /torchserve/config.properties
COPY torchserve/torchserve-entrypoint.sh /torchserve/torchserve-entrypoint.sh
CMD ["/torchserve/torchserve-entrypoint.sh"]

# 0. Always start from a clean sdkmanager, installation of Ubuntu 20.04. DO NOT attempt an in-place JetPack upgrade, DO NOT try to install docker-ce, and DO NOT try to re-install/replace CUDA without re-imaging the entire system.
# 1. Install JetPack via apt: https://docs.nvidia.com/jetson/jetpack/install-jetpack/index.html#install-jetpack. apt show nvidia-jetpack should show 5.1.2.
# 2. sudo apt-get disc-upgrade, reboot
# 3. git clone https://github.com/iqtlabs/gamutrf
# 4. cd gamutrf ; vi tests/test_torchserve.sh
# Change the docker run command line as follows:
# a) Change gamutrf-torchserve to gamutrf-orin-torchserve
# b) Insert —-runtime nvidia as first args, after docker run
# 5. sudo apt-get install python3-pip
# 6. Run tests/test_torchserve.sh. A successful test will print JSON prediction results. It may take 60s after the container starts, for it to return inference results as the model server installs ultralytics

0 comments on commit df3dd4a

Please sign in to comment.