nimibot System Test machine

What is nimibot

A collection of Virtual Machines behind the National Instruments firewall that monitor the nimi-python repository for PRs and automatically run all the system tests on supported environments.

These VMs are self hosted Azure Pipelines agents. The agents have all the driver runtimes installed, can execute system tests for all the supported drivers. Each driver systems tests are run in separate tox environment.

Because nimibot sits inside NI's firewall, external contributors cannot see the logs. An admin with access to NI's network needs to copy failing logs manually to the pull request (#1196).

nimibot consists of the following Virtual Machines:

• nimibot-win-32: Windows 10 64-bit system with 32-bit Python interpreters.
• nimibot-win-64: Windows 10 64-bit system with 64-bit Python interpreters.
• nimibot_rhel: RHEL 8.3 system with 64-bit Python interpreters.

Commands to trigger pull request

You can give commands to the system test runner via comments on the pull request.

nimibot will not run system tests on pull request from GitHub users that are not contributors to nimi-python automatically. Instead, a contributor must trigger the run by commenting on the pull request. These are the supported comment triggers.

Instructions to setup agent configuration

1. Install Operating Systems
2. Install Drivers (using last released DDVD): Driver versions tested against are mentioned in this document
3. Install Python
   • Windows 10 64-bit system with 32-bit Python interpreters: Install 32-bit Python3.
   • Windows 10 64-bit system with 64-bit Python interpreters: Install 64-bit Python3.
   • RHEL with 64-bit Python interpreters: Install 64 bit Python3.
   • Add Python installed paths to the PATH Variable.
   • Upgrade pip and setuptools.
   • Install tox: pip install tox
4. Install mingw(for Windows only)
   • Install mingw from https://sourceforge.net/projects/mingw/files/latest/download
   • Using installation manager, install mingw-developer-tools
   • Add "C:\MinGW\msys\1.0\bin" to path
5. Create simulated devices: "NI PXI-5124", "NI PXI-5142"
6. Command: tox -e clean,codegen && tox -e system_tests
7. Install Self hosted Azure agents on Windows 10 and RHEL 8.3. Four agents are installed on each platform for achieving parallelization.

Troubleshooting

ERROR: Could not find a version that satisfies the requirement. see #1658

If you encounter above issue please rerun the failed jobs.