openmv_person_detection

Person detection on OpenMV Cam H7

This is an example showing how to deploy the person detection model on OpenMV Cam H7 with TinyEngine.

Install build dependencies on Linux

Note: This section is basically from https://github.com/openmv/openmv/blob/master/src/README.md. Please refer to the OpenMV's repo for more details or steps on different env.

sudo apt-get update
sudo apt-get install git build-essential

Install GNU ARM toolchain

Install arm toolchain
TOOLCHAIN_PATH=/usr/local/arm-none-eabi
TOOLCHAIN_URL="https://armkeil.blob.core.windows.net/developer/Files/downloads/gnu-rm/10-2020q4/gcc-arm-none-eabi-10-2020-q4-major-x86_64-linux.tar.bz2"
sudo mkdir ${TOOLCHAIN_PATH}
wget --no-check-certificate -O - ${TOOLCHAIN_URL} | sudo tar --strip-components=1 -jx -C ${TOOLCHAIN_PATH}
export PATH=${TOOLCHAIN_PATH}/bin:${PATH}

Clone the OpenMV source

cd tinyengine/examples/openmv_person_detection/
git clone https://github.com/openmv/openmv.git

Currently, we don't have compatibility tests for the OpenMV source, so let's use the version that has been manually tested before.

cd openmv
git checkout 918ccb937730cc759ee5709df089d9de516dc7bf
git submodule update --init --recursive

Build the source

Let's first build the firmware from the source to make sure all required dependencies are correctly installed. The TARGET is set to OPENMV4 for OpenMV Cam H7.

make -j4 -C src/micropython/mpy-cross
make -j4 TARGET=OPENMV4 -C src

You should see the compiled binary at openmv/src/build/bin/firmware.bin.

Apply customized patch

The patch is to

1. disable some features in the firmware for SRAM and Flash space
2. setup for TinyEngine source
3. add the detection application code in exampleemodule.c

cd tinyengine/examples/openmv_person_detection/openmv
git apply ../openmv_person_detection.patch

Generate model-specific code for person detectopn

cd tinyengine/examples/openmv_person_detection
sh gen_code.sh

Copy the generated code at tinyengine/example/openmv_person_detection/codegen into TinyEngie.

Recompile the firmware with TinyEngine

cd openmv/
make -j4 TARGET=OPENMV4 -C src

Flash the binary openmv/src/build/bin/firmware.bin into your OpenMV. Please refer to the official Instructions.

Start the demo

1. Open OpenMV IDE
2. Connect your OpenMV cam to the PC
3. Run the python script tinyengine/examples/openmv_person_detection/person_detection_demo.py in OpenMV IDE.