21:03:00 Started by timer
21:03:00 Running as SYSTEM
21:03:00 [EnvInject] - Loading node environment variables.
21:03:00 Building remotely on prd-centos8-builder-2c-4g-10410 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
21:03:00 [ssh-agent] Looking for ssh-agent implementation...
21:03:00 $ ssh-agent
21:03:00 SSH_AUTH_SOCK=/tmp/ssh-TjOK0pL1FEKV/agent.5227
21:03:00 SSH_AGENT_PID=5230
21:03:00 [ssh-agent] Started.
21:03:00 Running ssh-add (command line suppressed)
21:03:00 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_14780752373974603958.key (jenkins-ssh)
21:03:00 [ssh-agent] Using credentials jenkins (jenkins)
21:03:00 The recommended git tool is: NONE
21:03:02 using credential jenkins
21:03:02 Wiping out workspace first.
21:03:02 Cloning the remote Git repository
21:03:02 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
21:03:02 > git init /w/workspace/ci-management-openstack-cron # timeout=10
21:03:02 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
21:03:02 > git --version # timeout=10
21:03:02 > git --version # 'git version 2.43.0'
21:03:02 using GIT_SSH to set credentials jenkins
21:03:02 [INFO] Currently running in a labeled security context
21:03:02 [INFO] Currently SELinux is 'enforcing' on the host
21:03:02 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh4320198459373744090.key
21:03:02 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
21:03:06 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
21:03:06 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
21:03:07 Avoid second fetch
21:03:07 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
21:03:07 Checking out Revision fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c (refs/remotes/origin/master)
21:03:07 > git config core.sparsecheckout # timeout=10
21:03:07 > git checkout -f fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10
21:03:07 Commit message: "Chore: Update global-jjb to v0.95.0"
21:03:07 > git rev-list --no-walk fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10
21:03:07 > git remote # timeout=10
21:03:07 > git submodule init # timeout=10
21:03:07 > git submodule sync # timeout=10
21:03:07 > git config --get remote.origin.url # timeout=10
21:03:07 > git submodule init # timeout=10
21:03:08 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
21:03:08 > git config --get submodule.packer/common-packer.url # timeout=10
21:03:08 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
21:03:08 > git config --get submodule.global-jjb.url # timeout=10
21:03:08 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
21:03:08 > git submodule update --init --recursive packer/common-packer # timeout=10
21:03:12 > git submodule update --init --recursive global-jjb # timeout=10
21:03:22 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:03:22 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:03:22 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:03:22 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:03:22 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:03:22 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:03:22 Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
21:03:22 provisioning config files...
21:03:22 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
21:03:22 copy managed file [npmrc] to file:/home/jenkins/.npmrc
21:03:22 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
21:03:22 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14791315740636679904.sh
21:03:22 ---> python-tools-install.sh
21:03:22 Setup pyenv:
21:03:23 system
21:03:23 * 3.8.13 (set by /opt/pyenv/version)
21:03:23 * 3.9.13 (set by /opt/pyenv/version)
21:03:23 * 3.10.6 (set by /opt/pyenv/version)
21:03:27 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-PO4O
21:03:27 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
21:03:27 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:03:38 lf-activate-venv(): INFO: Installing additional packages: lftools
21:04:18 lf-activate-venv(): INFO: Adding /tmp/venv-PO4O/bin to PATH
21:04:18 Generating Requirements File
21:04:59 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
21:04:59 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
21:04:59 Python 3.10.6
21:05:00 pip 26.2.1 from /tmp/venv-PO4O/lib/python3.10/site-packages/pip (python 3.10)
21:05:00 aiohappyeyeballs==2.7.1
21:05:00 aiohttp==3.14.3
21:05:00 aiosignal==1.4.0
21:05:00 appdirs==1.4.4
21:05:00 argcomplete==3.7.2
21:05:00 aspy.yaml==1.3.0
21:05:00 async-timeout==5.0.1
21:05:00 attrs==26.1.0
21:05:00 autopage==0.6.0
21:05:00 backports.strenum==1.3.1
21:05:00 beautifulsoup4==4.15.0
21:05:00 boto3==1.43.90
21:05:00 botocore==1.43.90
21:05:00 bs4==0.0.2
21:05:00 certifi==2026.7.22
21:05:00 cffi==2.1.1
21:05:00 cfgv==3.5.0
21:05:00 chardet==7.6.0
21:05:00 charset-normalizer==3.5.1
21:05:00 click==8.5.0
21:05:00 cliff==4.14.0
21:05:00 cmd2==3.5.1
21:05:00 cryptography==3.3.2
21:05:00 debtcollector==3.1.0
21:05:00 decorator==5.3.1
21:05:00 defusedxml==0.7.1
21:05:00 Deprecated==1.3.1
21:05:00 distlib==0.4.3
21:05:00 dnspython==2.8.0
21:05:00 docker==7.2.0
21:05:00 dogpile.cache==1.5.0
21:05:00 durationpy==0.11
21:05:00 email-validator==2.3.0
21:05:00 filelock==3.32.6
21:05:00 frozenlist==1.8.0
21:05:00 future==1.0.0
21:05:00 gitdb==4.0.12
21:05:00 GitPython==3.1.62
21:05:00 httplib2==0.30.2
21:05:00 identify==2.6.19
21:05:00 idna==3.19
21:05:00 importlib-resources==1.5.0
21:05:00 iso8601==2.1.0
21:05:00 Jinja2==3.1.6
21:05:00 jmespath==1.1.0
21:05:00 jsonpatch==1.33
21:05:00 jsonpointer==3.1.1
21:05:00 jsonschema==4.26.0
21:05:00 jsonschema-specifications==2025.9.1
21:05:00 keystoneauth1==5.14.0
21:05:00 kubernetes==36.0.3
21:05:00 lftools==0.37.23
21:05:00 lxml==6.1.3
21:05:00 markdown-it-py==4.2.0
21:05:00 MarkupSafe==3.0.3
21:05:00 mdurl==0.1.2
21:05:00 msgpack==1.2.2
21:05:00 multi_key_dict==2.0.3
21:05:00 multidict==6.8.0
21:05:00 munch==4.0.0
21:05:00 netaddr==1.3.0
21:05:00 niet==1.4.2
21:05:00 nodeenv==1.10.0
21:05:00 oauth2client==4.1.3
21:05:00 oauthlib==3.3.1
21:05:00 openstacksdk==4.13.0
21:05:00 os-service-types==1.8.2
21:05:00 osc-lib==4.6.0
21:05:00 oslo.config==10.4.0
21:05:00 oslo.context==6.4.0
21:05:00 oslo.i18n==6.8.0
21:05:00 oslo.log==8.2.0
21:05:00 oslo.serialization==5.10.0
21:05:00 oslo.utils==10.1.1
21:05:00 packaging==26.3
21:05:00 pbr==7.0.3
21:05:00 platformdirs==4.11.8
21:05:00 prettytable==3.18.0
21:05:00 propcache==0.5.2
21:05:00 psutil==7.2.2
21:05:00 pyasn1==0.6.4
21:05:00 pyasn1_modules==0.4.2
21:05:00 pycparser==3.0
21:05:00 pygerrit2==2.0.15
21:05:00 PyGithub==2.10.0
21:05:00 Pygments==2.21.0
21:05:00 PyJWT==2.13.0
21:05:00 PyNaCl==1.6.2
21:05:00 pyparsing==2.4.7
21:05:00 pyperclip==1.11.0
21:05:00 pyrsistent==0.20.0
21:05:00 python-cinderclient==9.9.0
21:05:00 python-dateutil==2.9.0.post0
21:05:00 python-discovery==1.6.0
21:05:00 python-heatclient==5.2.0
21:05:00 python-jenkins==1.8.3
21:05:00 python-keystoneclient==6.0.0
21:05:00 python-magnumclient==4.11.0
21:05:00 python-openstackclient==10.0.0
21:05:00 python-swiftclient==4.11.0
21:05:00 PyYAML==6.0.3
21:05:00 referencing==0.37.0
21:05:00 requests==2.34.2
21:05:00 requests-oauthlib==2.0.0
21:05:00 rfc3986==2.0.0
21:05:00 rich==15.0.0
21:05:00 rich-argparse==1.8.0
21:05:00 rpds-py==0.30.0
21:05:00 rsa==4.9.1
21:05:00 ruamel.yaml==0.19.1
21:05:00 ruamel.yaml.clib==0.2.15
21:05:00 s3transfer==0.19.2
21:05:00 simplejson==4.1.2
21:05:00 six==1.17.0
21:05:00 smmap==5.0.3
21:05:00 soupsieve==2.9.2
21:05:00 stevedore==5.8.0
21:05:00 tabulate==0.10.0
21:05:00 toml==0.10.2
21:05:00 tomlkit==0.15.1
21:05:00 tqdm==4.70.0
21:05:00 typing_extensions==4.16.0
21:05:00 urllib3==1.26.20
21:05:00 virtualenv==21.7.9
21:05:00 wcwidth==0.8.3
21:05:00 websocket-client==1.9.2
21:05:00 wrapt==2.4.0
21:05:00 xdg==6.0.0
21:05:00 xmltodict==1.0.4
21:05:00 yarl==1.24.5
21:05:00 yq==4.1.2
21:05:00 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins16439824369595613072.sh
21:05:00 ---> uv-install.sh
21:05:00 Installing uv/uvx (latest) using shell installer
21:05:07 2026-09-09 21:05:07 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71308/71308] -> "/tmp/uv-install-YGcTxO.sh" [1]
21:05:07 downloading uv 0.12.12 x86_64-unknown-linux-gnu
21:05:11 installing to /home/jenkins/.local/bin
21:05:11 uv
21:05:11 uvx
21:05:11 everything's installed!
21:05:11 ---> Validating uv/uvx install
21:05:11 uvx 0.12.12 (x86_64-unknown-linux-gnu)
21:05:11 [EnvInject] - Injecting environment variables from a build step.
21:05:11 [EnvInject] - Injecting as environment variables the properties content
21:05:11 OS_CLOUD=vex
21:05:11
21:05:11 [EnvInject] - Variables injected successfully.
21:05:11 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:05:11 Run condition [Boolean condition] enabling perform for step [Execute shell]
21:05:11 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3441151388928381493.sh
21:05:11 ---> Orphaned k8s clusters
21:05:11 Setup pyenv:
21:05:11 system
21:05:11 3.8.13
21:05:11 3.9.13
21:05:11 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
21:05:11 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PO4O from file:/tmp/.os_lf_venv
21:05:11 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:05:17 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient
21:05:31 lf-activate-venv(): INFO: Adding /tmp/venv-PO4O/bin to PATH
21:05:42 -----> Delete orphaned cluster
21:05:42 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:05:42 Run condition [Boolean condition] enabling perform for step [Execute shell]
21:05:42 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins13697688864621134768.sh
21:05:42 ---> Orphaned stacks
21:05:42 Setup pyenv:
21:05:42 system
21:05:42 3.8.13
21:05:42 3.9.13
21:05:42 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
21:05:42 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PO4O from file:/tmp/.os_lf_venv
21:05:42 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:05:47 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
21:06:12 lf-activate-venv(): INFO: Adding /tmp/venv-PO4O/bin to PATH
21:06:12 + mapfile -t OS_COE_CLUSTERS_ID
21:06:12 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
21:06:12 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
21:06:12 ++ awk '{print $1}'
21:08:22 + echo '-----> Active clusters -> stacks'
21:08:22 -----> Active clusters -> stacks
21:08:22 + OS_COE_STACKS=()
21:08:22 + [[ 0 -gt 0 ]]
21:08:22 + mapfile -t OS_STACKS
21:08:22 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
21:08:22 ++ awk '{print $1}'
21:08:30 + echo '-----> Active stacks'
21:08:30 -----> Active stacks
21:08:30 + echo '-----> Delete orphaned stacks'
21:08:30 -----> Delete orphaned stacks
21:08:30 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:08:30 Run condition [Boolean condition] enabling perform for step [Execute shell]
21:08:30 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins9931239520482096143.sh
21:08:30 ---> Orphaned servers
21:08:30 Setup pyenv:
21:08:30 system
21:08:30 3.8.13
21:08:30 3.9.13
21:08:31 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
21:08:31 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PO4O from file:/tmp/.os_lf_venv
21:08:31 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:08:36 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
21:08:58 lf-activate-venv(): INFO: Adding /tmp/venv-PO4O/bin to PATH
21:09:12 -----> Active servers
21:09:12 prd-ubuntu1804-docker-4c-4g-10420
21:09:12 prd-ubuntu1804-docker-4c-4g-10419
21:09:12 prd-ubuntu1804-docker-4c-4g-10417
21:09:12 prd-ubuntu1804-docker-4c-4g-10416
21:09:12 prd-centos8-builder-2c-4g-10410
21:09:12 -----> Delete orphaned servers
21:09:18 Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-10420
21:09:31 WARN: Server "prd-ubuntu1804-docker-4c-4g-10420" is not older than 15 minutes.
21:09:38 Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-10419
21:09:46 ERROR: Server not found.
21:09:53 Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-10417
21:10:02 ERROR: Server not found.
21:10:09 Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-10416
21:13:22 Build timed out (after 10 minutes). Marking the build as failed.
21:13:22 $ ssh-agent -k
21:13:22 unset SSH_AUTH_SOCK;
21:13:22 unset SSH_AGENT_PID;
21:13:22 echo Agent pid 5230 killed;
21:13:22 /tmp/jenkins9931239520482096143.sh: line 81: 6808 Terminated lftools openstack --os-cloud "$os_cloud" server remove --minutes 15 "$server"
21:13:23 [ssh-agent] Stopped.
21:13:23 Build was aborted
21:13:23 [PostBuildScript] - [INFO] Executing post build scripts.
21:13:23 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6457125813947560241.sh
21:13:23 ---> sysstat.sh
21:13:23 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13895464869516635568.sh
21:13:23 ---> package-listing.sh
21:13:23 ++ facter osfamily
21:13:23 ++ tr '[:upper:]' '[:lower:]'
21:13:23 + OS_FAMILY=redhat
21:13:23 + workspace=/w/workspace/ci-management-openstack-cron
21:13:23 + START_PACKAGES=/tmp/packages_start.txt
21:13:23 + END_PACKAGES=/tmp/packages_end.txt
21:13:23 + DIFF_PACKAGES=/tmp/packages_diff.txt
21:13:23 + PACKAGES=/tmp/packages_start.txt
21:13:23 + '[' /w/workspace/ci-management-openstack-cron ']'
21:13:23 + PACKAGES=/tmp/packages_end.txt
21:13:23 + case "${OS_FAMILY}" in
21:13:23 + rpm -qa
21:13:23 + sort
21:13:24 + '[' -f /tmp/packages_start.txt ']'
21:13:24 + '[' -f /tmp/packages_end.txt ']'
21:13:24 + diff /tmp/packages_start.txt /tmp/packages_end.txt
21:13:24 + '[' /w/workspace/ci-management-openstack-cron ']'
21:13:24 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
21:13:24 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
21:13:24 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins15664773907290770199.sh
21:13:24 ---> capture-instance-metadata.sh
21:13:24 Setup pyenv:
21:13:24 system
21:13:24 3.8.13
21:13:24 3.9.13
21:13:24 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
21:13:24 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PO4O from file:/tmp/.os_lf_venv
21:13:24 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:13:26 (23) Failed writing body
21:13:27 lf-activate-venv(): INFO: Installing additional packages: lftools
21:13:41 lf-activate-venv(): INFO: Adding /tmp/venv-PO4O/bin to PATH
21:13:42 INFO: Running in OpenStack, capturing instance metadata
21:13:42 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins17150405274391366706.sh
21:13:42 provisioning config files...
21:13:42 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config7010478195151910215tmp
21:13:42 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
21:13:42 Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
21:13:42 [EnvInject] - Injecting environment variables from a build step.
21:13:42 [EnvInject] - Injecting as environment variables the properties content
21:13:42 SERVER_ID=logs
21:13:42
21:13:42 [EnvInject] - Variables injected successfully.
21:13:42 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9819550691517926629.sh
21:13:42 ---> create-netrc.sh
21:13:42 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2360579573078233238.sh
21:13:42 ---> python-tools-install.sh
21:13:42 Setup pyenv:
21:13:42 system
21:13:42 3.8.13
21:13:42 3.9.13
21:13:42 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
21:13:42 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PO4O from file:/tmp/.os_lf_venv
21:13:42 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:13:47 lf-activate-venv(): INFO: Installing additional packages: lftools
21:14:02 lf-activate-venv(): INFO: Adding /tmp/venv-PO4O/bin to PATH
21:14:02 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins15820447720339841723.sh
21:14:02 ---> uv-install.sh
21:14:02 uv 0.12.12 is already installed
21:14:02 uvx 0.12.12 (x86_64-unknown-linux-gnu)
21:14:02 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16615522300419841076.sh
21:14:02 ---> sudo-logs.sh
21:14:02 Archiving 'sudo' log..
21:14:02 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11180660336197843079.sh
21:14:02 ---> job-cost.sh
21:14:02 INFO: Activating Python virtual environment...
21:14:02 Setup pyenv:
21:14:02 system
21:14:02 3.8.13
21:14:02 3.9.13
21:14:02 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
21:14:02 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PO4O from file:/tmp/.os_lf_venv
21:14:02 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:14:07 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15
21:14:19 lf-activate-venv(): INFO: Adding /tmp/venv-PO4O/bin to PATH
21:14:19 INFO: No stack-cost file found
21:14:19 INFO: Instance uptime: 1131s
21:14:19 INFO: Fetching instance metadata (attempt 1 of 3)...
21:14:19 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
21:14:51 INFO: Successfully fetched instance metadata
21:14:51 INFO: Instance type: 504 Gateway Time-out
21:14:51 The server didn't respond in time.
21:14:51
21:14:51 INFO: Retrieving pricing info for: 504 Gateway Time-out
21:14:51 The server didn't respond in time.
21:14:51
21:14:51 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
21:14:51 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/504 Gateway Time-out
21:14:51 The server didn't respond in time.
21:14:51 /cost?seconds=1131
21:14:51 ERROR: curl failed with exit code 3 for Vexxhost pricing API
21:14:51 ERROR: curl output: curl: (3) Illegal characters found in URL
21:14:51 INFO: Retrying in 10 seconds (exponential backoff)...
21:15:01 INFO: Fetching Vexxhost pricing API (attempt 2 of 3)...
21:15:01 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/504 Gateway Time-out
21:15:01 The server didn't respond in time.
21:15:01 /cost?seconds=1131
21:15:01 ERROR: curl failed with exit code 3 for Vexxhost pricing API
21:15:01 ERROR: curl output: curl: (3) Illegal characters found in URL
21:15:01 INFO: Retrying in 20 seconds (exponential backoff)...
21:15:21 INFO: Fetching Vexxhost pricing API (attempt 3 of 3)...
21:15:21 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/504 Gateway Time-out
21:15:21 The server didn't respond in time.
21:15:21 /cost?seconds=1131
21:15:21 ERROR: curl failed with exit code 3 for Vexxhost pricing API
21:15:21 ERROR: curl output: curl: (3) Illegal characters found in URL
21:15:21 ERROR: All 3 attempts failed for Vexxhost pricing API
21:15:21 ERROR: Failed to retrieve pricing information after 3 attempts
21:15:21 INFO: Continuing with default values: cost=0, resource=unknown
21:15:21 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost
21:15:21 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv
21:15:21 INFO: Successfully archived job cost data
21:15:21 DEBUG: Cost data: ci-management-openstack-cron,62266,2026-09-09 21:15:21,unknown,1131,0.00,0.00,FAILURE
21:15:21 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins10173689376754273991.sh
21:15:21 ---> logs-deploy.sh
21:15:21 Setup pyenv:
21:15:21 system
21:15:21 3.8.13
21:15:21 3.9.13
21:15:21 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
21:15:21 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PO4O from file:/tmp/.os_lf_venv
21:15:21 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:15:26 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15
21:15:40 lf-activate-venv(): INFO: Adding /tmp/venv-PO4O/bin to PATH
21:15:40 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/62266
21:15:40 INFO: archiving workspace using pattern(s):
21:15:44 Archives upload complete.
21:15:45 INFO: archiving logs to Nexus
21:15:46 ---> uname -a:
21:15:46 Linux prd-centos8-builder-2c-4g-10410.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
21:15:46
21:15:46
21:15:46 ---> lscpu:
21:15:46 Architecture: x86_64
21:15:46 CPU op-mode(s): 32-bit, 64-bit
21:15:46 Byte Order: Little Endian
21:15:46 CPU(s): 2
21:15:46 On-line CPU(s) list: 0,1
21:15:46 Thread(s) per core: 1
21:15:46 Core(s) per socket: 1
21:15:46 Socket(s): 2
21:15:46 NUMA node(s): 1
21:15:46 Vendor ID: AuthenticAMD
21:15:46 CPU family: 23
21:15:46 Model: 49
21:15:46 Model name: AMD EPYC-Rome Processor
21:15:46 Stepping: 0
21:15:46 CPU MHz: 2800.000
21:15:46 BogoMIPS: 5600.00
21:15:46 Virtualization: AMD-V
21:15:46 Hypervisor vendor: KVM
21:15:46 Virtualization type: full
21:15:46 L1d cache: 32K
21:15:46 L1i cache: 32K
21:15:46 L2 cache: 512K
21:15:46 L3 cache: 16384K
21:15:46 NUMA node0 CPU(s): 0,1
21:15:46 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
21:15:46
21:15:46
21:15:46 ---> nproc:
21:15:46 2
21:15:46
21:15:46
21:15:46 ---> df -h:
21:15:46 Filesystem Size Used Avail Use% Mounted on
21:15:46 devtmpfs 1.8G 0 1.8G 0% /dev
21:15:46 tmpfs 1.8G 0 1.8G 0% /dev/shm
21:15:46 tmpfs 1.8G 17M 1.8G 1% /run
21:15:46 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup
21:15:46 /dev/vda1 20G 9.2G 11G 46% /
21:15:46 tmpfs 367M 0 367M 0% /run/user/1001
21:15:46
21:15:46
21:15:46 ---> free -m:
21:15:46 total used free shared buff/cache available
21:15:46 Mem: 3665 505 987 17 2172 2882
21:15:46 Swap: 1023 0 1023
21:15:46
21:15:46
21:15:46 ---> ip addr:
21:15:46 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
21:15:46 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
21:15:46 inet 127.0.0.1/8 scope host lo
21:15:46 valid_lft forever preferred_lft forever
21:15:46 inet6 ::1/128 scope host
21:15:46 valid_lft forever preferred_lft forever
21:15:46 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000
21:15:46 link/ether fa:16:3e:87:3f:27 brd ff:ff:ff:ff:ff:ff
21:15:46 altname enp0s3
21:15:46 altname ens3
21:15:46 inet 10.32.7.44/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
21:15:46 valid_lft 85214sec preferred_lft 85214sec
21:15:46 inet6 fe80::f816:3eff:fe87:3f27/64 scope link
21:15:46 valid_lft forever preferred_lft forever
21:15:46
21:15:46
21:15:46 ---> sar -b -r -n DEV:
21:15:46 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 09/09/2026 _x86_64_ (2 CPU)
21:15:46
21:15:46 20:55:36 LINUX RESTART (2 CPU)
21:15:46
21:15:46 08:57:01 PM tps rtps wtps bread/s bwrtn/s
21:15:46 08:58:01 PM 2.32 0.00 2.32 0.00 57.03
21:15:46 08:59:01 PM 0.18 0.00 0.18 0.00 2.50
21:15:46 09:00:01 PM 0.23 0.03 0.20 0.53 1.98
21:15:46 09:01:01 PM 0.28 0.02 0.27 0.13 2.98
21:15:46 09:02:01 PM 0.38 0.07 0.32 1.73 5.86
21:15:46 09:03:01 PM 2.58 2.37 0.22 344.82 2.40
21:15:46 09:04:01 PM 61.54 7.37 54.17 1070.09 2435.93
21:15:46 09:05:01 PM 73.56 0.55 73.01 142.75 8876.47
21:15:46 09:06:02 PM 37.34 0.68 36.65 91.57 8743.75
21:15:46 09:07:01 PM 18.83 0.05 18.78 1.36 2059.13
21:15:46 09:08:01 PM 4.40 0.00 4.40 0.00 151.39
21:15:46 09:09:01 PM 10.25 0.00 10.25 0.00 428.37
21:15:46 09:10:01 PM 8.70 0.82 7.88 52.39 373.57
21:15:46 09:11:01 PM 3.00 0.00 3.00 0.00 107.53
21:15:46 09:12:01 PM 0.85 0.00 0.85 0.00 17.33
21:15:46 09:13:01 PM 0.22 0.00 0.22 0.00 2.80
21:15:46 09:14:01 PM 9.53 0.25 9.28 25.06 223.01
21:15:46 09:15:01 PM 19.01 0.23 18.78 24.66 1008.66
21:15:46 Average: 14.06 0.69 13.37 97.59 1360.51
21:15:46
21:15:46 08:57:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty
21:15:46 08:58:01 PM 1791360 3152976 1962316 52.28 2104 1544964 517752 10.78 114096 1616420 4
21:15:46 08:59:01 PM 1789112 3150728 1964564 52.34 2104 1544964 517752 10.78 114104 1618804 4
21:15:46 09:00:01 PM 1788516 3150152 1965160 52.35 2104 1544984 535620 11.15 114116 1619116 4
21:15:46 09:01:01 PM 1788228 3149860 1965448 52.36 2104 1544984 516276 10.75 114116 1619332 4
21:15:46 09:02:01 PM 1788732 3150436 1964944 52.35 2104 1545056 516276 10.75 114144 1619244 4
21:15:46 09:03:01 PM 1739060 3116400 2014616 53.67 2104 1560772 546720 11.38 115992 1667348 5384
21:15:46 09:04:01 PM 1495812 3012200 2257864 60.15 2104 1693860 623208 12.98 143832 1860104 56508
21:15:46 09:05:01 PM 1183244 3018084 2570432 68.48 2104 1995036 573676 11.95 144400 2105984 170648
21:15:46 09:06:02 PM 1006212 2922796 2747464 73.19 2104 2076120 659680 13.74 150556 2269804 18408
21:15:46 09:07:01 PM 1030888 2964984 2722788 72.54 2104 2092840 614044 12.79 159688 2232288 4
21:15:46 09:08:01 PM 1033132 2966720 2720544 72.48 2104 2092844 614044 12.79 159688 2232132 4
21:15:46 09:09:01 PM 1036592 2970372 2717084 72.38 2104 2092828 610048 12.70 174768 2214060 6728
21:15:46 09:10:01 PM 1014252 2949428 2739424 72.98 2104 2094384 629876 13.12 187664 2224108 4
21:15:46 09:11:01 PM 1011112 2946292 2742564 73.06 2104 2094388 628368 13.08 187892 2226092 16
21:15:46 09:12:01 PM 1011428 2946608 2742248 73.05 2104 2094388 628368 13.08 187892 2226040 4
21:15:46 09:13:01 PM 1011432 2946616 2742244 73.05 2104 2094392 628368 13.08 187892 2225876 4
21:15:46 09:14:01 PM 974084 2916252 2779592 74.05 2104 2101168 656632 13.67 372672 2079752 11680
21:15:46 09:15:01 PM 1077336 3018072 2676340 71.30 2104 2099200 556432 11.59 379076 1967660 8
21:15:46 Average: 1309474 3024943 2444202 65.11 2104 1883732 587397 12.23 173477 1979120 14968
21:15:46
21:15:46 08:57:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil
21:15:46 08:58:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 08:58:01 PM eth0 1.02 0.40 1.46 0.03 0.00 0.00 0.00 0.00
21:15:46 08:59:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 08:59:01 PM eth0 0.20 0.10 0.01 0.01 0.00 0.00 0.00 0.00
21:15:46 09:00:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:00:01 PM eth0 0.10 0.12 0.01 0.01 0.00 0.00 0.00 0.00
21:15:46 09:01:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:01:01 PM eth0 0.10 0.10 0.01 0.01 0.00 0.00 0.00 0.00
21:15:46 09:02:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:02:01 PM eth0 0.38 0.18 0.15 0.07 0.00 0.00 0.00 0.00
21:15:46 09:03:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:03:01 PM eth0 24.68 13.75 107.93 9.91 0.00 0.00 0.00 0.00
21:15:46 09:04:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:04:01 PM eth0 78.10 58.27 653.07 28.24 0.00 0.00 0.00 0.00
21:15:46 09:05:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:05:01 PM eth0 44.62 38.94 780.54 5.31 0.00 0.00 0.00 0.00
21:15:46 09:06:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:06:02 PM eth0 75.06 54.90 490.13 7.34 0.00 0.00 0.00 0.00
21:15:46 09:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:07:01 PM eth0 26.10 22.10 493.53 5.47 0.00 0.00 0.00 0.00
21:15:46 09:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:08:01 PM eth0 0.12 0.10 0.01 0.01 0.00 0.00 0.00 0.00
21:15:46 09:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:09:01 PM eth0 5.70 6.71 3.23 3.04 0.00 0.00 0.00 0.00
21:15:46 09:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:10:01 PM eth0 7.23 6.80 8.72 0.98 0.00 0.00 0.00 0.00
21:15:46 09:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:11:01 PM eth0 2.13 1.88 1.42 0.44 0.00 0.00 0.00 0.00
21:15:46 09:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:12:01 PM eth0 0.38 0.30 0.15 0.08 0.00 0.00 0.00 0.00
21:15:46 09:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:13:01 PM eth0 0.15 0.13 0.01 0.01 0.00 0.00 0.00 0.00
21:15:46 09:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:14:01 PM eth0 11.48 10.93 7.86 5.46 0.00 0.00 0.00 0.00
21:15:46 09:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 09:15:01 PM eth0 4.38 4.30 3.23 1.99 0.00 0.00 0.00 0.00
21:15:46 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
21:15:46 Average: eth0 15.65 12.21 141.42 3.80 0.00 0.00 0.00 0.00
21:15:46
21:15:46
21:15:46 ---> sar -P ALL:
21:15:46 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 09/09/2026 _x86_64_ (2 CPU)
21:15:46
21:15:46 20:55:36 LINUX RESTART (2 CPU)
21:15:46
21:15:46 08:57:01 PM CPU %user %nice %system %iowait %steal %idle
21:15:46 08:58:01 PM all 0.48 0.00 0.07 0.03 0.04 99.39
21:15:46 08:58:01 PM 0 0.65 0.00 0.10 0.05 0.07 99.13
21:15:46 08:58:01 PM 1 0.30 0.00 0.03 0.00 0.02 99.65
21:15:46 08:59:01 PM all 0.13 0.00 0.09 0.00 0.04 99.74
21:15:46 08:59:01 PM 0 0.15 0.00 0.10 0.00 0.03 99.72
21:15:46 08:59:01 PM 1 0.10 0.00 0.08 0.00 0.05 99.77
21:15:46 09:00:01 PM all 0.31 0.00 0.06 0.00 0.04 99.59
21:15:46 09:00:01 PM 0 0.05 0.00 0.03 0.00 0.02 99.90
21:15:46 09:00:01 PM 1 0.57 0.00 0.08 0.00 0.07 99.28
21:15:46 09:01:01 PM all 0.32 0.00 0.08 0.00 0.04 99.56
21:15:46 09:01:01 PM 0 0.10 0.00 0.12 0.00 0.07 99.72
21:15:46 09:01:01 PM 1 0.53 0.00 0.05 0.00 0.02 99.40
21:15:46 09:02:01 PM all 0.45 0.00 0.07 0.00 0.04 99.44
21:15:46 09:02:01 PM 0 0.08 0.00 0.08 0.00 0.03 99.80
21:15:46 09:02:01 PM 1 0.82 0.00 0.05 0.00 0.05 99.08
21:15:46 09:03:01 PM all 2.15 0.00 0.23 0.05 0.05 97.52
21:15:46 09:03:01 PM 0 1.55 0.00 0.33 0.10 0.03 97.98
21:15:46 09:03:01 PM 1 2.75 0.00 0.12 0.00 0.07 97.06
21:15:46 09:04:01 PM all 17.49 0.00 2.87 2.72 0.08 76.85
21:15:46 09:04:01 PM 0 15.40 0.00 2.89 4.19 0.07 77.45
21:15:46 09:04:01 PM 1 19.58 0.00 2.84 1.25 0.08 76.24
21:15:46 09:05:01 PM all 28.62 0.00 3.77 2.27 0.09 65.25
21:15:46 09:05:01 PM 0 10.64 0.00 2.28 1.98 0.10 84.99
21:15:46 09:05:01 PM 1 46.63 0.00 5.26 2.55 0.08 45.48
21:15:46 09:06:02 PM all 19.96 0.00 2.20 1.26 0.08 76.50
21:15:46 09:06:02 PM 0 11.11 0.00 1.89 1.10 0.10 85.80
21:15:46 09:06:02 PM 1 28.81 0.00 2.50 1.42 0.07 67.20
21:15:46 09:07:01 PM all 7.62 0.00 0.90 0.69 0.08 90.71
21:15:46 09:07:01 PM 0 8.13 0.00 1.02 0.36 0.10 90.40
21:15:46 09:07:01 PM 1 7.12 0.00 0.78 1.02 0.05 91.03
21:15:46 09:08:01 PM all 0.23 0.00 0.06 0.12 0.04 99.56
21:15:46 09:08:01 PM 0 0.40 0.00 0.07 0.07 0.05 99.41
21:15:46 09:08:01 PM 1 0.05 0.00 0.05 0.17 0.03 99.70
21:15:46
21:15:46 09:08:01 PM CPU %user %nice %system %iowait %steal %idle
21:15:46 09:09:01 PM all 16.30 0.00 1.13 0.03 0.07 82.48
21:15:46 09:09:01 PM 0 21.06 0.00 1.20 0.03 0.05 77.65
21:15:46 09:09:01 PM 1 11.53 0.00 1.05 0.02 0.08 87.32
21:15:46 09:10:01 PM all 3.68 0.00 0.59 0.23 0.04 95.46
21:15:46 09:10:01 PM 0 5.53 0.00 0.77 0.30 0.03 93.37
21:15:46 09:10:01 PM 1 1.82 0.00 0.40 0.17 0.05 97.56
21:15:46 09:11:01 PM all 1.38 0.00 0.35 0.13 0.05 98.10
21:15:46 09:11:01 PM 0 0.70 0.00 0.33 0.25 0.07 98.65
21:15:46 09:11:01 PM 1 2.05 0.00 0.37 0.00 0.03 97.55
21:15:46 09:12:01 PM all 0.32 0.00 0.05 0.00 0.03 99.60
21:15:46 09:12:01 PM 0 0.07 0.00 0.05 0.00 0.03 99.85
21:15:46 09:12:01 PM 1 0.57 0.00 0.05 0.00 0.03 99.35
21:15:46 09:13:01 PM all 0.23 0.00 0.05 0.00 0.05 99.67
21:15:46 09:13:01 PM 0 0.10 0.00 0.07 0.00 0.07 99.77
21:15:46 09:13:01 PM 1 0.35 0.00 0.03 0.00 0.03 99.58
21:15:46 09:14:01 PM all 18.82 0.00 1.78 0.07 0.08 79.26
21:15:46 09:14:01 PM 0 20.30 0.00 1.75 0.05 0.10 77.80
21:15:46 09:14:01 PM 1 17.33 0.00 1.80 0.08 0.07 80.71
21:15:46 09:15:01 PM all 8.30 0.00 1.21 0.71 0.07 89.71
21:15:46 09:15:01 PM 0 9.12 0.00 1.30 0.22 0.05 89.32
21:15:46 09:15:01 PM 1 7.49 0.00 1.12 1.20 0.08 90.11
21:15:46 Average: all 7.04 0.00 0.86 0.46 0.06 91.57
21:15:46 Average: 0 5.84 0.00 0.80 0.48 0.06 92.81
21:15:46 Average: 1 8.25 0.00 0.93 0.44 0.05 90.34
21:15:46
21:15:46
21:15:46