Add python #1138
Comments
|
@suzuki-shunsuke I suspect it isn't possible with the current version of aqua but maybe this type of releases could be used instead: The issue with python seems to be that it has a lot of system dependencies and that python then has to be rebuild quite regularly. These builds are used by rye, bazel and some other build tools to download a binary python so it's an unofficial standard. |
|
Hi, thank you for your suggestion. |
|
https://github.com/indygreg/python-build-standalone/releases/tag/20240726 Hmm. Each release has assets for multiple Python versions (3.10.14, 3.11.9, etc). e.g. - name: indygreg/python-build-standalone@20240726 # Can't specify python versionMy idea is to enable aqua to specify parameters. e.g. - name: indygreg/python-build-standalone@20240726
with:
python_version: "3.10.14" |
|
It seems rye indexes the releases to know which version it can download from which release. So when updating the release the 'python_version' should also be checked to see if it needs to be updated. https://github.com/astral-sh/rye/blob/main/rye-devtools/src/rye_devtools/find_downloads.py |
|
Related:
|
|
📝 After we support parameters, aquaproj/aqua#3052 |
|
Maybe you should look into https://github.com/jdx/mise. To me mise is to specify Node, Phyton, Java versions - so languages coming with an own dependency management and Aqua for single binary tools. I see aqua as version manager, I don't see that I could also put configuration next to the version E.g. for python https://mise.jdx.dev/lang/python.html |
|
@mab I currently use mise and it is sometimes flaky to get new developers to pick it up. Because its based on ASDF plugins it is hard to add new tools. And some plugins are a bit brittle. Like checkov needed jq installed to work. To me aqua seems simpler since it only downloads binaries and better on the front of security and managing the 'registry'. Ideally mise would use the aqua repository by default and have several special install scripts baked in for python, java, ruby and others where it isn't trivial to install these tools. |
|
WIP export PIP_TARGET=$(aqua root-dir)/pip-global # location where pip installs tools
export PATH=$PIP_TARGET/bin:$PATH
export PYTHONPATH=$PIP_TARGET # Without this setting, tools installed by pip didn't workpip install mkdocs
mkdocs -VI found an issue that even if I change the Python version, seems like mkdocs -V refers to old Python.
$ mkdocs -V
mkdocs, version 1.6.0 from /Users/shunsukesuzuki/.local/share/aquaproj-aqua/pip-global/mkdocs (Python 3.11)I'm not familiar with Python, but Python creates cache *.pyc. $ ls -lh /Users/shunsukesuzuki/.local/share/aquaproj-aqua/pip-global/mkdocs/__pycache__
total 84K
-rw-r--r-- 1 shunsukesuzuki staff 237 8 23 09:02 __init__.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff 20K 8 23 09:02 __main__.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff 2.4K 8 23 09:02 exceptions.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff 4.7K 8 23 09:02 localization.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff 35K 8 23 09:02 plugins.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff 8.8K 8 23 09:02 theme.cpython-311.pyc |
This is a bit confusing, but doesn't so matter. |
|
📝 This isn't official but aqua can get the list of Python versions from this repository. https://github.com/containerbase/python-prebuild Python provides API, but aqua doesn't support getting versions from API. https://www.python.org/api/v2/downloads/release/ ref. https://docs.renovatebot.com/modules/datasource/python-version/ |
Remaining tasks
|
|
Hmm... Python works on macOS, but doesn't work on Linux container. Set up a container according to https://aquaproj.github.io/docs/tutorial/#docker docker run --rm -ti debian:bookworm-20231009 bashapt update
apt install -y curl vim
mkdir ~/workspace
cd ~/workspace
export PATH="${AQUA_ROOT_DIR:-${XDG_DATA_HOME:-$HOME/.local/share}/aquaproj-aqua}/bin:$PATH"
curl -sSfL -O https://raw.githubusercontent.com/aquaproj/aqua-installer/v3.0.1/aqua-installer
echo "fb4b3b7d026e5aba1fc478c268e8fbd653e01404c8a8c6284fdba88ae62eda6a aqua-installer" | sha256sum -c
chmod +x aqua-installer
./aqua-installerUpdate aqua to v2.31.0-2. aqua upa v2.31.0-2aqua.yaml registries:
- type: standard
ref: bcc7a2c5ae39a84af41b7ca559ac619e3f85e8ed
packages:
- name: indygreg/python-build-standalone@20240726
vars:
python_version: 3.11.9aqua i -l
python -Vroot@bc0be027deb3:~/workspace# python
Could not find platform independent libraries <prefix>
Could not find platform dependent libraries <exec_prefix>
Python path configuration:
PYTHONHOME = (not set)
PYTHONPATH = (not set)
program name = 'python'
isolated = 0
environment = 1
user site = 1
safe_path = 0
import site = 1
is in build tree = 0
stdlib dir = '/install/lib/python3.11'
sys._base_executable = '/root/.local/share/aquaproj-aqua/bin/python'
sys.base_prefix = '/install'
sys.base_exec_prefix = '/install'
sys.platlibdir = 'lib'
sys.executable = '/root/.local/share/aquaproj-aqua/bin/python'
sys.prefix = '/install'
sys.exec_prefix = '/install'
sys.path = [
'/install/lib/python311.zip',
'/install/lib/python3.11',
'/install/lib/python3.11/lib-dynload',
]
Fatal Python error: init_fs_encoding: failed to get the Python codec of the filesystem encoding
Python runtime state: core initialized
ModuleNotFoundError: No module named 'encodings'
Current thread 0x0000ffff82890020 (most recent call first):
<no Python frame> |
#858
https://github.com/danhper/asdf-python
https://www.python.org/
The text was updated successfully, but these errors were encountered: