Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3.7.0.36 #107

Merged
merged 78 commits into from
Nov 6, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
78 commits
Select commit Hold shift + click to select a range
b962034
New version
Oct 3, 2023
51b3572
Testing stuck job monitor
PalNilsson Oct 4, 2023
c4ba6be
Aborting job monitoring (and pilot) after tobekilled
PalNilsson Oct 4, 2023
b5baefe
Cleanup
PalNilsson Oct 4, 2023
d859dfe
Testing informing the server after tobekilled
Oct 4, 2023
9710186
Testing informing the server after tobekilled
Oct 4, 2023
dc08141
Updated version
Oct 6, 2023
e23be16
Added pre-commit
Oct 6, 2023
5727707
Test
Oct 6, 2023
ec478ad
Updated URL
Oct 6, 2023
3bf5755
Pre-commit changes
Oct 6, 2023
98ac893
Added comment
Oct 6, 2023
c5d59b6
Test pre-commit
Oct 6, 2023
d873a30
Test pre-commit
Oct 10, 2023
985d224
Do not include os.getpid() in list
Oct 10, 2023
346350c
Simplified get_subprocesses()
Oct 10, 2023
1aa9123
Simplified get_subprocesses()
Oct 10, 2023
c63d7bb
Using the youngest child pid to create core file for looping job. Mov…
Oct 11, 2023
353aeec
Updated log messages
Oct 11, 2023
ade4adb
Added several files to be cleaned up
Oct 11, 2023
0d13de3
Verification of container script for tokens. Refactoring
Oct 12, 2023
5ba3ed5
Added log messages
Oct 12, 2023
aed7a24
Moved container verification
Oct 13, 2023
9f97310
Corrected Apache license header
Oct 13, 2023
77ef308
Corrected Apache license header
Oct 13, 2023
c528e1e
Corrected Apache license header
Oct 13, 2023
59eb978
Corrected Apache license header
Oct 13, 2023
77f651c
Corrected Apache license header
Oct 13, 2023
9f161e5
Corrected Apache license header
Oct 13, 2023
19bb7e5
Corrected Apache license header
Oct 13, 2023
48b5096
Corrected Apache license header
Oct 13, 2023
5836ac0
Corrected Apache license header
Oct 13, 2023
0ae7b04
Corrected Apache license header
Oct 13, 2023
2c28b89
Corrected Apache license header
Oct 13, 2023
c7b833a
Corrected Apache license header
Oct 13, 2023
46a10d6
Corrected Apache license header
Oct 13, 2023
aacf239
Corrected Apache license header
Oct 13, 2023
c9b56d5
Corrected Apache license header
Oct 13, 2023
0718443
Corrected Apache license header
Oct 13, 2023
1d97cd4
Corrected Apache license header
Oct 13, 2023
3cc2de1
Corrected Apache license header
Oct 13, 2023
bc20c74
Corrected Apache license header
Oct 13, 2023
949c47c
Fixed error handling of internal bug. Preparing for secrets
Oct 17, 2023
8ff404e
Extraction of registry, username and token
PalNilsson Oct 17, 2023
4a56405
Extraction of registry, username and token
PalNilsson Oct 17, 2023
5ea4706
Extraction of registry, username and token
PalNilsson Oct 17, 2023
ae5ab3b
Extraction of registry, username and token
PalNilsson Oct 17, 2023
30fe73f
Test
PalNilsson Oct 17, 2023
90fe4f0
Update
PalNilsson Oct 17, 2023
332201a
pandasecrets handling
Oct 17, 2023
22efb5a
Refactoring
Oct 18, 2023
9894ab9
Added documentation
Oct 18, 2023
196cb4e
Pylint improvements
Oct 18, 2023
a4bbe96
Pylint improvements - write_json related changes, removed raising exc…
Oct 18, 2023
a8473f5
Updated version
Oct 19, 2023
e7f2b63
Corrected bad variable name
Oct 19, 2023
d2a26d5
Added error handling
Oct 30, 2023
7449b68
Copying special files before tar
Oct 31, 2023
e5feb2d
Copying special files before tar
Oct 31, 2023
e44cbec
Name update
PalNilsson Oct 31, 2023
7c0e9d0
Doc update
Oct 31, 2023
45f62b8
Pydocstyle updates
Nov 1, 2023
72d4262
Pydocstyle updates
Nov 1, 2023
f9690ed
Pydocstyle updates
Nov 1, 2023
1b05e22
Pydocstyle and pylint updates
Nov 1, 2023
956d033
Refactoring and renaming of xrdlog from payload
Nov 1, 2023
e199887
f-string
Nov 1, 2023
d444da7
Added xrdlog to exceptions list
Nov 1, 2023
aff2e3d
Update
Nov 2, 2023
d7f2832
Pylint and pydocstyle updates
PalNilsson Nov 2, 2023
cfa9836
Pylint updates
PalNilsson Nov 3, 2023
f328531
Pydocstyle updates
PalNilsson Nov 3, 2023
7ec0405
Updated with black
Nov 3, 2023
79c0c6f
Updated with black, pydocstyle and pylint
Nov 3, 2023
e28f3d0
Improved log warning
Nov 3, 2023
26f2553
pydocstyle and pylint updates
Nov 3, 2023
8f305a7
pydocstyle and pylint updates
Nov 3, 2023
7f2af70
Merge pull request #106 from PalNilsson/next
PalNilsson Nov 6, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .github/workflows/build-docs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,4 +32,3 @@ jobs:
READDOCS_TOKEN: ${{ secrets.READDOCS_TOKEN }}
READDOCS_HOOK: ${{ secrets.READDOCS_HOOK }}
run: curl -X POST -d "token=$READDOCS_TOKEN" $READDOCS_HOOK

13 changes: 13 additions & 0 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# See https://pre-commit.com for more information
# See https://pre-commit.com/hooks.html for more hooks
# Run 'pre-commit run --all-files' manually if hooks are added or changed
repos:
- repo: https://github.com/pre-commit/pre-commit-hooks
rev: v3.2.0
hooks:
- id: trailing-whitespace
- id: check-added-large-files
- repo: https://github.com/PyCQA/flake8
rev: 6.1.0
hooks:
- id: flake8
1 change: 0 additions & 1 deletion .pylintrc
Original file line number Diff line number Diff line change
Expand Up @@ -569,4 +569,3 @@ check-str-concat-over-line-jumps=no
# suggestions which would get split by a code formatter (e.g., black). Will
# default to the setting for ``max-line-length``.
max-line-length-suggestions=120

2 changes: 1 addition & 1 deletion PILOTVERSION
Original file line number Diff line number Diff line change
@@ -1 +1 @@
3.6.9.10
3.7.0.36
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@

2. Fork the ``PanDAWMS/pilot3`` repository into your private account as ``origin``. Clone it and set the ``PanDAWMS/pilot3`` repository as ``upstream``.

3. Make new code contributions only to a new branch in your repository, push to ``origin`` and make a pull request into ``upstream``. Depending on the type of contribution this should go to either ``upstream/next`` or ``upstream/hotfix``.
3. Make new code contributions only to a new branch in your repository, push to ``origin`` and make a pull request into ``upstream``. Depending on the type of contribution this should go to either ``upstream/next`` or ``upstream/hotfix``.
Any pull requests directly to the master branch will be rejected since that would trigger the automatic pilot tarball creation.
## Verifying code correctness

Expand Down
24 changes: 19 additions & 5 deletions __init__.py
Original file line number Diff line number Diff line change
@@ -1,8 +1,22 @@
#!/usr/bin/env python
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
# http://www.apache.org/licenses/LICENSE-2.0
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#
# Authors:
# - Paul Nilsson, [email protected], 2020
# - Paul Nilsson, [email protected], 2020-23

"""Default init."""
1 change: 0 additions & 1 deletion doc/Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -25,4 +25,3 @@ help:
# "make mode" option. $(O) is meant as a shortcut for $(SPHINXOPTS).
%: Makefile
@$(SPHINXBUILD) -M $@ "$(SOURCEDIR)" "$(BUILDDIR)" $(SPHINXOPTS) $(O)

1 change: 0 additions & 1 deletion doc/components/copytool/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -21,4 +21,3 @@ copytool components
mv
rucio
xrdcp

2 changes: 0 additions & 2 deletions doc/components/eventservice/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -20,5 +20,3 @@ eventservice components
esmanager
esmessage
esprocess


3 changes: 0 additions & 3 deletions doc/components/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,3 @@ Components
user/index
util/index
workflow/index



2 changes: 0 additions & 2 deletions doc/components/user/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -17,5 +17,3 @@ user components

atlas/index
generic/index


3 changes: 0 additions & 3 deletions doc/components/util/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,3 @@ util components
timer
timing
workernode



23 changes: 18 additions & 5 deletions doc/conf.py
Original file line number Diff line number Diff line change
@@ -1,12 +1,25 @@
#!/usr/bin/env python
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
# http://www.apache.org/licenses/LICENSE-2.0
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#
# Authors:
# - Daniel Drizhuk, [email protected], 2017

# - Paul Nilsson, [email protected], 2023
#
# -*- coding: utf-8 -*-
#
# Pilot 2 documentation build configuration file, created by
Expand Down
2 changes: 1 addition & 1 deletion doc/getting_started/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@ Getting started
.. toctree::
:maxdepth: 2

launch
launch
9 changes: 0 additions & 9 deletions doc/getting_started/launch.rst
Original file line number Diff line number Diff line change
Expand Up @@ -66,12 +66,3 @@ this to `managed` while `user` is the value for user jobs. Setting it to `test`
``--allow_same_user``: Multi-jobs will only come from same taskID and thus same user (boolean).

``--pilot_user``: Pilot user (string). E.g. name of experiment.









Loading