Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tweak for WorkQueueManager #1479

Merged

Conversation

todor-ivanov
Copy link
Contributor

Fixes dmwm/WMCore#11986

With this change we add the forgotten tweaks for testbed agents to use Producion Rucio instead of integration.

Copy link
Contributor

@amaltaro amaltaro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Todor, please find comments/requests along the code.

@@ -415,6 +421,10 @@ agent_tweakconfig() {
GLOBAL_DBS_URL=https://cmsweb-testbed.cern.ch/dbs/int/global/DBSReader
sed -i "s+DBSInterface.globalDBSUrl = 'https://cmsweb.cern.ch/dbs/prod/global/DBSReader'+DBSInterface.globalDBSUrl = '$GLOBAL_DBS_URL'+" $WMA_CONFIG_DIR/config.py
sed -i "s+DBSInterface.DBSUrl = 'https://cmsweb.cern.ch/dbs/prod/global/DBSReader'+DBSInterface.DBSUrl = '$GLOBAL_DBS_URL'+" $WMA_CONFIG_DIR/config.py
rucio_host=http://cms-rucio.cern.ch
rucio_auth=https://cms-rucio-auth.cern.ch
sed -i "s+WorkQueueManager.rucioUrl =.*+WorkQueueManager.rucioUrl+WorkQueueManager.rucioUrl = $rucio_host'+" $WMA_CONFIG_DIR/config.py
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You have one item extra in this sed command, in addition to be missing a single quote. The command you wanted is likely: sed -i "s+WorkQueueManager.rucioUrl =.*+WorkQueueManager.rucioUrl = '$rucio_host'+" $WMA_CONFIG_DIR/config.py

But please make sure to test these out

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks. fixed

rucio_host=http://cms-rucio.cern.ch
rucio_auth=https://cms-rucio-auth.cern.ch
sed -i "s+WorkQueueManager.rucioUrl =.*+WorkQueueManager.rucioUrl+WorkQueueManager.rucioUrl = $rucio_host'+" $WMA_CONFIG_DIR/config.py
sed -i "s+WorkQueueManager.rucioAuthUrl =.*+WorkQueueManager.rucioUrl+WorkQueueManager.rucioAuthUrl = $rucio_auth'+" $WMA_CONFIG_DIR/config.py
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar comment here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

@@ -415,6 +421,10 @@ agent_tweakconfig() {
GLOBAL_DBS_URL=https://cmsweb-testbed.cern.ch/dbs/int/global/DBSReader
sed -i "s+DBSInterface.globalDBSUrl = 'https://cmsweb.cern.ch/dbs/prod/global/DBSReader'+DBSInterface.globalDBSUrl = '$GLOBAL_DBS_URL'+" $WMA_CONFIG_DIR/config.py
sed -i "s+DBSInterface.DBSUrl = 'https://cmsweb.cern.ch/dbs/prod/global/DBSReader'+DBSInterface.DBSUrl = '$GLOBAL_DBS_URL'+" $WMA_CONFIG_DIR/config.py
rucio_host=http://cms-rucio.cern.ch
rucio_auth=https://cms-rucio-auth.cern.ch
sed -i "s+WorkQueueManager.rucioUrl = .*+WorkQueueManager.rucioUrl = $rucio_host+" $WMA_CONFIG_DIR/config.py
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will break the configuration file, as you ditched out the single quotes making the url string.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed
Here is the output of applying the lines to the config file:

(WMAgent-2.3.4rc3) [cmst1@vocms0260:current]$ sed -i "s+WorkQueueManager.rucioAuthUrl = .*+WorkQueueManager.rucioAuthUrl = '$rucio_auth'+" $WMA_CONFIG_DIR/config.py

(WMAgent-2.3.4rc3) [cmst1@vocms0260:current]$ sed -i "s+WorkQueueManager.rucioUrl = .*+WorkQueueManager.rucioUrl = '$rucio_host'+" $WMA_CONFIG_DIR/config.py

(WMAgent-2.3.4rc3) [cmst1@vocms0260:current]$ grep cms-rucio $WMA_CONFIG_DIR/config.py |grep WorkQueueManager
config.WorkQueueManager.rucioUrl = 'http://cms-rucio.cern.ch'
config.WorkQueueManager.rucioAuthUrl = 'http://cms-rucio-auth.cern.ch'

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wonderful, thanks Todor!

Copy link
Contributor

@amaltaro amaltaro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, thanks Todor!

@amaltaro amaltaro merged commit 2ca92db into dmwm:master May 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

WMAgent: Forgotten tweak for WorkQueueManager to use production Rucio for data discovery
2 participants