Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

included venv activation for python scripts #2233

Merged
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
60042f4
add setup script for rfid reader. moved python script
AlvinSchiller Jan 30, 2024
31bd3b6
add check for venv activation
AlvinSchiller Jan 31, 2024
973175f
fix
AlvinSchiller Jan 31, 2024
39f5378
fix cd fail behavior (dont start subprocess)
AlvinSchiller Jan 31, 2024
7bd2339
add script for run jukebox for venv.
AlvinSchiller Jan 31, 2024
f65d260
add setup script for audio sink. moved python script
AlvinSchiller Jan 31, 2024
73d5583
add script for rpc tool. moved python script
AlvinSchiller Jan 31, 2024
0490ca3
add script for sniffer tool. moved python script
AlvinSchiller Jan 31, 2024
dd2c7af
fixed parameter passing
AlvinSchiller Jan 31, 2024
f18dad6
fix paths
AlvinSchiller Jan 31, 2024
7248ad2
fix flake8
AlvinSchiller Jan 31, 2024
d00a203
fix comments and docs
AlvinSchiller Jan 31, 2024
7c87cea
fixed parameter passing
AlvinSchiller Jan 31, 2024
c979672
some fixes
AlvinSchiller Jan 31, 2024
e6f969c
fixed execution rights
AlvinSchiller Jan 31, 2024
4877161
some fixes
AlvinSchiller Jan 31, 2024
654d031
move scripts to python root again (failing import paths).
AlvinSchiller Feb 1, 2024
81fac26
fix relative paths
AlvinSchiller Feb 1, 2024
1b86e1a
update notes about config file paths
AlvinSchiller Feb 1, 2024
7cda2cb
update caller scripts path handling
AlvinSchiller Feb 1, 2024
6219f71
update comments
AlvinSchiller Feb 1, 2024
86b210e
add venv activation to tests
AlvinSchiller Feb 1, 2024
a33c25c
explicit installation of python3-venv not needed
AlvinSchiller Feb 1, 2024
0b5b5da
renamed audio setup file.
AlvinSchiller Feb 1, 2024
47f50ec
Update configuration.md
pabera Feb 2, 2024
6d72819
Update coreapps.md
pabera Feb 2, 2024
dbf293c
Merge branch 'future3/develop' into future3/fix/venvdoc_shell
AlvinSchiller Feb 2, 2024
a587bd8
update motd message
AlvinSchiller Feb 2, 2024
eb86473
fix execution rights for motd file.
AlvinSchiller Feb 2, 2024
b526a9e
fix execution right for audio setup
AlvinSchiller Feb 3, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .githooks/post-merge
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,7 @@ warn_python_requirements() {
echo "ATTENTION: Python requirements have changed since last pull!"
echo ""
echo "To update python requirements on the RPi run"
echo "$ source .venv/bin/activate"
echo "$ python -m pip install --upgrade -r requirements.txt"
echo "************************************************************"
echo -e "\n"
Expand Down
3 changes: 3 additions & 0 deletions .github/workflows/codeql-analysis_v3.yml
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,9 @@ jobs:
run: |
# Install necessary packages
sudo apt-get install libasound2-dev pulseaudio
python3 -m venv .venv
source ".venv/bin/activate"

python -m pip install --upgrade pip
pip install -r requirements.txt
# Set the `CODEQL-PYTHON` environment variable to the Python executable
Expand Down
4 changes: 3 additions & 1 deletion .github/workflows/pythonpackage_future3.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,9 @@ jobs:
run: |
sudo apt-get update
sudo apt-get install -y libasound2-dev pulseaudio
python3 -m venv .venv
source ".venv/bin/activate"

python3 -m pip install --upgrade pip
pip3 install -r requirements.txt
# For operation of the Jukebox, ZMQ must be compiled from sources due to Websocket support
Expand All @@ -51,7 +54,6 @@ jobs:
parallel: true
- name: Lint with flake8
run: |
pip3 install flake8
# Stop the build if linting fails
./run_flake8.sh

Expand Down
20 changes: 9 additions & 11 deletions documentation/builders/configuration.md
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
# Jukebox Configuration

The Jukebox configuration is managed by a set of files located in `shared/settings`.
Some configuration changes can be made through the WebUI and take immediate effect.
Some configuration changes can be made through the Web App and take immediate effect.

The majority of configuration options is only available by editing the config files -
The majority of configuration options are only available by editing the config files -
*when the service is not running!*
Don't fear (overly), they contain commentaries.

For several aspects we have [configuration tools](../developers/coreapps.md#configuration-tools) and [detailed guides](./README.md#features).
For several aspects, we have [configuration tools](../developers/coreapps.md#configuration-tools) and [detailed guides](./README.md#features).

Even after running the tools, certain aspects can only be changed by modifying the configuration files directly.
Even after using the tools, certain aspects can only be changed by directly modifying the configuration files.

## Best practice procedure

Expand All @@ -21,19 +21,17 @@ $ systemctl --user stop jukebox-daemon
$ nano ./shared/settings/jukebox.yaml

# Start Jukebox in console and check the log output (optional)
$ cd src/jukebox
$ ./run_jukebox.py
$ ./run_jukebox.sh
# and if OK, press Ctrl-C and restart the service

# Restart the service
$ systemctl --user start jukebox-daemon
```

To try different configurations, you can start the Jukebox with a custom config file.
To try different configurations, you can start the Jukebox with a custom config file.
This could be useful if you want your Jukebox to only allow a lower volume when started
at night time when there is time to go to bed :-)
at nighttime, signaling it's time to go to bed. :-)
The path to the custom config file must be either absolute or relative to the folder `src/jukebox/`.

```bash
$ cd src/jukebox
$ ./run_jukebox.py --conf path/to/custom/config.yaml
$ ./run_jukebox.sh --conf /absolute/path/to/custom/config.yaml
```
9 changes: 3 additions & 6 deletions documentation/builders/troubleshooting.md
Original file line number Diff line number Diff line change
Expand Up @@ -64,12 +64,10 @@ on the console log.
$ systemctl --user stop jukebox-daemon

# Start the Jukebox in debug mode:
$ cd src/jukebox

# with default logger:
$ ./run_jukebox.py
$ ./run_jukebox.sh
# or with custom logger configuration:
$ ./run_jukebox.py --logger path/to/custom/logger.yaml
$ ./run_jukebox.sh --logger path/to/custom/logger.yaml
```

### Fallback configuration
Expand All @@ -79,8 +77,7 @@ Attention: This only emits messages to the console and does not write to the log
This is more a fallback features:

```bash
$ cd src/jukebox
$ ./run_jukebox.py -vv
$ ./run_jukebox.sh -vv
```

### Extreme cases
Expand Down
37 changes: 17 additions & 20 deletions documentation/developers/coreapps.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
# Jukebox Apps

The Jukebox\'s core apps are located in `src/jukebox`. Run the following
command to learn more about each app and its parameters:
The Jukebox's core apps are located in `src/jukebox`. To learn more about each app and its parameters, run the following command:

``` bash
$ cd src/jukebox
Expand All @@ -10,13 +9,13 @@ $ ./<scriptname> -h

## Jukebox Core

**Scriptname:** [run_jukebox.py](../../src/jukebox/run_jukebox.py)
**Scriptname:** [run_jukebox.sh](../../run_jukebox.sh)

This is the main app and starts the Jukebox Core.
This is the main app. It starts the Jukebox Core.

Usually this runs as a service, which is started automatically after boot-up. At times, it may be necessary to restart the service. For example after a configuration change. Not all configuration changes can be applied on-the-fly. See [Jukebox Configuration](../builders/configuration.md#jukebox-configuration).
This runs as a service, which starts automatically after boot-up. At times, it may be necessary to restart the service, for example, after a configuration change. Not all configuration changes can be applied on-the-fly. See [Jukebox Configuration](../builders/configuration.md#jukebox-configuration).

For debugging, it is usually desirable to run the Jukebox directly from the console rather than as service. This gives direct logging info in the console and allows changing command line parameters. See [Troubleshooting](../builders/troubleshooting.md).
For debugging, it's best to run Jukebox directly from the console rather than as a service, as this provides direct logging information in the console and allows for changing command line parameters. See [Troubleshooting](../builders/troubleshooting.md).

## Configuration Tools

Expand All @@ -25,41 +24,39 @@ See [Best practice procedure](../builders/configuration.md#best-practice-procedu

### Audio

**Scriptname:** [run_configure_audio.py](../../src/jukebox/run_configure_audio.py)
**Scriptname:** [setup_configure_audio.sh](../../installation/components/setup_configure_audio.sh)

Setup tool to register the PulseAudio sinks as primary and secondary audio outputs.
A setup tool to register the PulseAudio sinks as primary and secondary audio outputs.

Will also setup equalizer and mono down mixer in the pulseaudio config file. Run this once after installation. Can be re-run at any time to change the settings. For more information see [Audio Configuration](../builders/audio.md).
This will also set up an equalizer and mono downmixer in the PulseAudio configuration file. Run this once after installation. It can be re-run at any time to change the settings. For more information see [Audio Configuration](../builders/audio.md).

### RFID Reader

**Scriptname:** [run_register_rfid_reader.py](../../src/jukebox/run_register_rfid_reader.py)
**Scriptname:** [setup_rfid_reader.sh](../../installation/components/setup_rfid_reader.sh)

Setup tool to configure the RFID Readers.

Run this once to register and configure the RFID readers with the Jukebox. Can be re-run at any time to change the settings. For more information see [RFID Readers](./rfid/README.md).
Run this once to register and configure the RFID readers with Jukebox. It can be re-run at any time to change the settings. For more information see [RFID Readers](./rfid/README.md).

> [!NOTE]
> This tool will always write a new configurations file. Thus, overwrite the old one (after checking with the user). Any manual modifications to the settings will have to be re-applied
> This tool will always create a new configuration file, thereby overwriting the old one (after confirming with the user). Any manual modifications to the settings will need to be reapplied.

## Developer Tools

### RPC

**Scriptname:** [run_rpc_tool.py](../../src/jukebox/run_rpc_tool.py)
**Scriptname:** [run_rpc_tool.sh](../../tools/run_rpc_tool.sh)

Command Line Interface to the Jukebox RPC Server.

A command line tool for sending RPC commands to the running jukebox app. This uses the same interface as the WebUI. Can be used for additional control or for debugging. Use `./run_rpc_tool.py` to start the tool in interactive mode.
A command-line tool for sending RPC commands to the running Jukebox app, utilizing the same interface as the Web App, provides additional control or debugging capabilities. Start the tool in interactive mode with `./run_rpc_tool.sh`.

The tool features auto-completion and command history.
Features include auto-completion and command history, with available commands fetched from the running Jukebox service.

The list of available commands is fetched from the running Jukebox service.

The tool can also be used to send commands directly, when passing a `-c` argument, e.g. `./run_rpc_tool.py -c host.shutdown`.
For direct command execution, use the `-c` argument, e.g., `./run_rpc_tool.sh -c host.shutdown`.

### Publicity Sniffer

**Scriptname:** [run_publicity_sniffer.py](../../src/jukebox/run_publicity_sniffer.py)
**Scriptname:** [run_publicity_sniffer.sh](../../tools/run_publicity_sniffer.sh)

A command line tool that monitors all messages being sent out from the Jukebox via the publishing interface. Received messages are printed in the console. Mainly used for debugging.
This command-line tool monitors all messages sent from Jukebox through the publishing interface, printing received messages in the console. It is primarily used for debugging.
2 changes: 1 addition & 1 deletion documentation/developers/known-issues.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,6 @@ RUN cd ${HOME} && mkdir ${ZMQ_TMP_DIR} && cd ${ZMQ_TMP_DIR}; \
## Configuration

In `jukebox.yaml` (and all other config files):
Always use relative path from settingsfile `../../`, but do not use relative paths with `~/`.
Always use relative path from folder `src/jukebox` (`../../`), but do not use relative paths with `~/`.

**Sole** exception is in `playermpd.mpd_conf`.
16 changes: 16 additions & 0 deletions installation/components/setup_configure_audio.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
#!/usr/bin/env bash

# Runner script to ensure
# - correct venv activation
# - independent from working directory

# Change working directory to project root
SOURCE=${BASH_SOURCE[0]}
SCRIPT_DIR="$(dirname "$SOURCE")"
PROJECT_ROOT="$SCRIPT_DIR"/../..
cd "$PROJECT_ROOT" || { echo "Could not change directory"; exit 1; }

source .venv/bin/activate || { echo "ERROR: Failed to activate virtual environment for python"; exit 1; }

cd src/jukebox || { echo "Could not change directory"; exit 1; }
python run_configure_audio.py $@
16 changes: 16 additions & 0 deletions installation/components/setup_rfid_reader.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
#!/usr/bin/env bash

# Runner script to ensure
# - correct venv activation
# - independent from working directory

# Change working directory to project root
SOURCE=${BASH_SOURCE[0]}
SCRIPT_DIR="$(dirname "$SOURCE")"
PROJECT_ROOT="$SCRIPT_DIR"/../..
cd "$PROJECT_ROOT" || { echo "Could not change directory"; exit 1; }

source .venv/bin/activate || { echo "ERROR: Failed to activate virtual environment for python"; exit 1; }

cd src/jukebox || { echo "Could not change directory"; exit 1; }
python run_register_rfid_reader.py $@
2 changes: 1 addition & 1 deletion installation/routines/install.sh
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,6 @@ install() {
setup_rfid_reader
optimize_boot_time
setup_autohotspot
setup_login_message
setup_postinstall
cleanup
}
4 changes: 0 additions & 4 deletions installation/routines/set_raspi_config.sh
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,3 @@ _run_set_raspi_config() {
set_raspi_config() {
run_with_log_frame _run_set_raspi_config "Set default raspi-config"
}

setup_login_message() {
sudo cp -f "${INSTALLATION_PATH}/resources/system/99-rpi-jukebox-rfid-welcome" "/etc/update-motd.d/99-rpi-jukebox-rfid-welcome"
}
13 changes: 13 additions & 0 deletions installation/routines/setup_postinstall.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
_setup_login_message() {
local login_message_welcome_file="/etc/update-motd.d/99-rpi-jukebox-rfid-welcome"
sudo cp -f "${INSTALLATION_PATH}/resources/system/99-rpi-jukebox-rfid-welcome" "$login_message_welcome_file"
sudo chmod +x "$login_message_welcome_file"
}

_run_setup_postinstall() {
_setup_login_message
}

setup_postinstall() {
run_with_log_frame _run_setup_postinstall "Post install"
}
4 changes: 3 additions & 1 deletion installation/routines/setup_rfid_reader.sh
Original file line number Diff line number Diff line change
@@ -1,7 +1,9 @@
#!/usr/bin/env bash

_run_setup_rfid_reader() {
run_and_print_lc python "${INSTALLATION_PATH}/src/jukebox/run_register_rfid_reader.py"
local script="${INSTALLATION_PATH}"/installation/components/setup_rfid_reader.sh
sudo chmod +x "$script"
run_and_print_lc "$script"
}

setup_rfid_reader() {
Expand Down
4 changes: 2 additions & 2 deletions resources/default-services/jukebox-daemon.service
Original file line number Diff line number Diff line change
Expand Up @@ -10,8 +10,8 @@ After=network.target sound.target mpd.service pulseaudio.service
Requires=mpd.service pulseaudio.service

[Service]
WorkingDirectory=%%INSTALLATION_PATH%%/src/jukebox
ExecStart=/bin/bash -c 'source %%INSTALLATION_PATH%%/.venv/bin/activate && python run_jukebox.py'
WorkingDirectory=%%INSTALLATION_PATH%%
ExecStart=/bin/bash -c '%%INSTALLATION_PATH%%/run_jukebox.sh'
StandardOutput=inherit
StandardError=inherit
Restart=always
Expand Down
2 changes: 1 addition & 1 deletion resources/default-settings/jukebox.default.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# IMPORTANT:
# Always use relative path from settingsfile `../../`, but do not use relative paths with `~/`.
# Always use relative path from folder `src/jukebox` (`../../`), but do not use relative paths with `~/`.
# Sole (!) exception is in playermpd.mpd_conf
system:
box_name: Jukebox
Expand Down
2 changes: 1 addition & 1 deletion resources/default-settings/pulseaudio.default.pa
Original file line number Diff line number Diff line change
Expand Up @@ -147,5 +147,5 @@ load-module module-filter-apply
#set-default-source input

### Configuration by Jukebox's Tool may come below
# Run ./run_configure_audio.py for configuration
# Run ./installation/components/setup_configure_audio.sh for configuration

12 changes: 4 additions & 8 deletions resources/system/99-rpi-jukebox-rfid-welcome
Original file line number Diff line number Diff line change
@@ -1,16 +1,12 @@
#!/usr/bin/env bash

echo "
#########################################################
##################################################
___ __ ______ _ __________ ____ __ _ _
/ _ \/ // / __ \/ |/ / _/ __/( _ \ / \( \/ )
/ ___/ _ / /_/ / // // _/ ) _ (( O )) (
/_/ /_//_/\____/_/|_/___/____/ (____/ \__/(_/\_)
future3

If you want to run a python script from the project
activate the venv before with 'source .venv/bin/activate'
See also https://github.com/MiczFlor/RPi-Jukebox-RFID/
blob/future3/main/documentation/developers/python.md

#########################################################"
Welcome to your Phoniebox
##################################################
"
10 changes: 7 additions & 3 deletions run_docgeneration.sh
Original file line number Diff line number Diff line change
@@ -1,12 +1,16 @@
#!/usr/bin/env bash

# Runner script for pydoc-markdown to ensure
# Runner script to ensure
# - correct venv activation
# - independent from working directory

# Change working directory to location of script
# Change working directory to project root
SOURCE=${BASH_SOURCE[0]}
SCRIPT_DIR="$(dirname "$SOURCE")"
cd "$SCRIPT_DIR" || (echo "Could not change to top-level project directory" && exit 1)
PROJECT_ROOT="$SCRIPT_DIR"
cd "$PROJECT_ROOT" || { echo "Could not change directory"; exit 1; }

source .venv/bin/activate || { echo "ERROR: Failed to activate virtual environment for python"; exit 1; }

# Run pydoc-markdown
# make sure, directory exists
Expand Down
11 changes: 7 additions & 4 deletions run_flake8.sh
Original file line number Diff line number Diff line change
@@ -1,13 +1,16 @@
#!/usr/bin/env bash

# Runner script for flak8 to ensure
# - correct config file
# Runner script to ensure
# - correct venv activation
# - independent from working directory

# Change working directory to location of script
# Change working directory to project root
SOURCE=${BASH_SOURCE[0]}
SCRIPT_DIR="$(dirname "$SOURCE")"
cd "$SCRIPT_DIR" || (echo "Could not change to top-level project directory" && exit 1)
PROJECT_ROOT="$SCRIPT_DIR"
cd "$PROJECT_ROOT" || { echo "Could not change directory"; exit 1; }

source .venv/bin/activate || { echo "ERROR: Failed to activate virtual environment for python"; exit 1; }

# Run flake8
flake8 --config .flake8 "$@"
16 changes: 16 additions & 0 deletions run_jukebox.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
#!/usr/bin/env bash

# Runner script to ensure
# - correct venv activation
# - independent from working directory

# Change working directory to project root
SOURCE=${BASH_SOURCE[0]}
SCRIPT_DIR="$(dirname "$SOURCE")"
PROJECT_ROOT="$SCRIPT_DIR"
cd "$PROJECT_ROOT" || { echo "Could not change directory"; exit 1; }

source .venv/bin/activate || { echo "ERROR: Failed to activate virtual environment for python"; exit 1; }

cd src/jukebox || { echo "Could not change directory"; exit 1; }
python run_jukebox.py $@
11 changes: 7 additions & 4 deletions run_pytest.sh
Original file line number Diff line number Diff line change
@@ -1,13 +1,16 @@
#!/usr/bin/env bash

# Runner script for pytest to ensure
# - correct config file
# Runner script to ensure
# - correct venv activation
# - independent from working directory

# Change working directory to location of script
# Change working directory to project root
SOURCE=${BASH_SOURCE[0]}
SCRIPT_DIR="$(dirname "$SOURCE")"
cd "$SCRIPT_DIR" || (echo "Could not change to top-level project directory" && exit 1)
PROJECT_ROOT="$SCRIPT_DIR"
cd "$PROJECT_ROOT" || { echo "Could not change directory"; exit 1; }

source .venv/bin/activate || { echo "ERROR: Failed to activate virtual environment for python"; exit 1; }

# Run pytest
pytest -c pytest.ini $@
Loading
Loading