02:23:08 Started by timer
02:23:08 Running as SYSTEM
02:23:09 [EnvInject] - Loading node environment variables.
02:23:09 Building remotely on prd-centos8-builder-2c-4g-240 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
02:23:09 [ssh-agent] Looking for ssh-agent implementation...
02:23:09 $ ssh-agent
02:23:09 SSH_AUTH_SOCK=/tmp/ssh-Zz7oMrHXJdfq/agent.5154
02:23:09 SSH_AGENT_PID=5156
02:23:09 [ssh-agent] Started.
02:23:09 Running ssh-add (command line suppressed)
02:23:09 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_14963816347042236036.key (jenkins-ssh)
02:23:09 [ssh-agent] Using credentials jenkins (jenkins)
02:23:09 The recommended git tool is: NONE
02:23:11 using credential jenkins
02:23:11 Wiping out workspace first.
02:23:11 Cloning the remote Git repository
02:23:11 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
02:23:11 > git init /w/workspace/ci-management-openstack-cron # timeout=10
02:23:11 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
02:23:11 > git --version # timeout=10
02:23:11 > git --version # 'git version 2.43.0'
02:23:11 using GIT_SSH to set credentials jenkins
02:23:11 [INFO] Currently running in a labeled security context
02:23:11 [INFO] Currently SELinux is 'enforcing' on the host
02:23:11 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh10864339574359049976.key
02:23:11 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
02:23:15 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
02:23:15 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
02:23:16 Avoid second fetch
02:23:16 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
02:23:16 Checking out Revision fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c (refs/remotes/origin/master)
02:23:16 > git config core.sparsecheckout # timeout=10
02:23:16 > git checkout -f fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10
02:23:16 Commit message: "Chore: Update global-jjb to v0.95.0"
02:23:16 > git rev-list --no-walk fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10
02:23:16 > git remote # timeout=10
02:23:16 > git submodule init # timeout=10
02:23:17 > git submodule sync # timeout=10
02:23:17 > git config --get remote.origin.url # timeout=10
02:23:17 > git submodule init # timeout=10
02:23:17 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
02:23:17 > git config --get submodule.packer/common-packer.url # timeout=10
02:23:17 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
02:23:17 > git config --get submodule.global-jjb.url # timeout=10
02:23:17 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
02:23:17 > git submodule update --init --recursive packer/common-packer # timeout=10
02:23:21 > git submodule update --init --recursive global-jjb # timeout=10
02:23:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:23:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:23:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:23:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:23:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:23:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:23:31 Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
02:23:31 provisioning config files...
02:23:31 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
02:23:31 copy managed file [npmrc] to file:/home/jenkins/.npmrc
02:23:31 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
02:23:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2627850597884873291.sh
02:23:31 ---> python-tools-install.sh
02:23:31 Setup pyenv:
02:23:31 system
02:23:31 * 3.8.13 (set by /opt/pyenv/version)
02:23:31 * 3.9.13 (set by /opt/pyenv/version)
02:23:31 * 3.10.6 (set by /opt/pyenv/version)
02:23:36 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-CSBc
02:23:36 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
02:23:36 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:23:48 lf-activate-venv(): INFO: Installing additional packages: lftools
02:24:54 lf-activate-venv(): INFO: Adding /tmp/venv-CSBc/bin to PATH
02:24:54 Generating Requirements File
02:26:01 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:26:01 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
02:26:01 Python 3.10.6
02:26:02 pip 26.2.1 from /tmp/venv-CSBc/lib/python3.10/site-packages/pip (python 3.10)
02:26:02 aiohappyeyeballs==2.7.1
02:26:02 aiohttp==3.14.5
02:26:02 aiosignal==1.4.0
02:26:02 appdirs==1.4.4
02:26:02 argcomplete==3.7.2
02:26:02 aspy.yaml==1.3.0
02:26:02 async-timeout==5.0.1
02:26:02 attrs==26.1.0
02:26:02 autopage==0.6.0
02:26:02 backports.strenum==1.3.1
02:26:02 beautifulsoup4==4.15.0
02:26:02 boto3==1.43.114
02:26:02 botocore==1.43.114
02:26:02 bs4==0.0.2
02:26:02 certifi==2026.7.22
02:26:02 cffi==2.1.1
02:26:02 cfgv==3.5.0
02:26:02 chardet==7.6.0
02:26:02 charset-normalizer==3.5.2
02:26:02 click==8.5.0
02:26:02 cliff==4.14.0
02:26:02 cmd2==3.5.1
02:26:02 cryptography==3.3.2
02:26:02 debtcollector==3.1.0
02:26:02 decorator==5.3.1
02:26:02 defusedxml==0.7.1
02:26:02 Deprecated==1.3.1
02:26:02 distlib==0.4.3
02:26:02 dnspython==2.8.0
02:26:02 docker==7.2.0
02:26:02 dogpile.cache==1.5.0
02:26:02 durationpy==0.11
02:26:02 email-validator==2.3.0
02:26:02 filelock==4.1.0
02:26:02 frozenlist==1.8.0
02:26:02 future==1.0.0
02:26:02 gitdb==4.0.12
02:26:02 GitPython==3.2.1
02:26:02 httplib2==0.30.2
02:26:02 identify==2.6.20
02:26:02 idna==3.20
02:26:02 importlib-resources==1.5.0
02:26:02 iso8601==2.1.0
02:26:02 Jinja2==3.1.6
02:26:02 jmespath==1.1.0
02:26:02 jsonpatch==1.35
02:26:02 jsonpointer==3.2.1
02:26:02 jsonschema==4.26.0
02:26:02 jsonschema-specifications==2025.9.1
02:26:02 keystoneauth1==5.14.0
02:26:02 kubernetes==36.0.3
02:26:02 lftools==0.37.26
02:26:02 lxml==6.1.3
02:26:02 markdown-it-py==4.2.0
02:26:02 MarkupSafe==3.0.4
02:26:02 mdurl==0.1.2
02:26:02 msgpack==1.2.3
02:26:02 multi_key_dict==2.0.3
02:26:02 multidict==7.1.0
02:26:02 munch==4.0.0
02:26:02 netaddr==1.3.0
02:26:02 niet==1.4.2
02:26:02 nodeenv==1.11.0
02:26:02 oauth2client==4.1.3
02:26:02 oauthlib==4.0.0
02:26:02 openstacksdk==4.13.0
02:26:02 os-service-types==1.8.2
02:26:02 osc-lib==4.6.0
02:26:02 oslo.config==10.4.0
02:26:02 oslo.context==6.4.0
02:26:02 oslo.i18n==6.8.0
02:26:02 oslo.log==8.2.0
02:26:02 oslo.serialization==5.10.0
02:26:02 oslo.utils==10.1.1
02:26:02 packaging==26.3
02:26:02 pbr==7.1.3
02:26:02 platformdirs==4.12.4
02:26:02 prettytable==3.18.0
02:26:02 propcache==0.5.4
02:26:02 psutil==7.2.2
02:26:02 pyasn1==0.6.4
02:26:02 pyasn1_modules==0.4.2
02:26:02 pycparser==3.11
02:26:02 pygerrit2==2.0.15
02:26:02 PyGithub==2.10.0
02:26:02 Pygments==2.21.0
02:26:02 PyJWT==2.15.1
02:26:02 PyNaCl==1.6.2
02:26:02 pyparsing==2.4.7
02:26:02 pyperclip==1.11.0
02:26:02 pyrsistent==0.20.0
02:26:02 python-cinderclient==9.9.0
02:26:02 python-dateutil==2.9.0.post0
02:26:02 python-discovery==1.6.3
02:26:02 python-heatclient==5.2.0
02:26:02 python-jenkins==1.8.3
02:26:02 python-keystoneclient==6.0.0
02:26:02 python-magnumclient==4.11.0
02:26:02 python-openstackclient==10.0.0
02:26:02 python-swiftclient==4.11.0
02:26:02 PyYAML==6.0.3
02:26:02 referencing==0.37.0
02:26:02 requests==2.34.2
02:26:02 requests-oauthlib==2.0.0
02:26:02 rfc3986==2.0.0
02:26:02 rich==15.0.0
02:26:02 rich-argparse==1.8.0
02:26:02 rpds-py==0.30.0
02:26:02 rsa==4.9.1
02:26:02 ruamel.yaml==0.19.1
02:26:02 ruamel.yaml.clib==0.2.15
02:26:02 s3transfer==0.19.2
02:26:02 simplejson==4.2.0
02:26:02 six==1.17.0
02:26:02 smmap==5.0.3
02:26:02 soupsieve==2.10
02:26:02 stevedore==5.8.0
02:26:02 tabulate==0.10.0
02:26:02 toml==0.10.2
02:26:02 tomlkit==0.15.2
02:26:02 tqdm==4.70.1
02:26:02 typing_extensions==4.16.0
02:26:02 urllib3==1.26.20
02:26:02 virtualenv==21.14.8
02:26:02 wcwidth==0.9.2
02:26:02 websocket-client==1.9.2
02:26:02 wrapt==2.5.1
02:26:02 xdg==6.0.0
02:26:02 xmltodict==1.0.4
02:26:02 yarl==1.25.1
02:26:02 yq==4.4.5
02:26:02 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins16309940291316195437.sh
02:26:02 ---> uv-install.sh
02:26:02 Installing uv/uvx (latest) using shell installer
02:26:09 2026-10-17 02:26:09 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-sgERmz.sh" [1]
02:26:09 downloading uv 0.13.1 x86_64-unknown-linux-gnu
02:26:13 installing to /home/jenkins/.local/bin
02:26:13 uv
02:26:13 uvx
02:26:13 everything's installed!
02:26:13 ---> Validating uv/uvx install
02:26:13 uvx 0.13.1 (x86_64-unknown-linux-gnu)
02:26:13 [EnvInject] - Injecting environment variables from a build step.
02:26:13 [EnvInject] - Injecting as environment variables the properties content
02:26:13 OS_CLOUD=vex
02:26:13
02:26:13 [EnvInject] - Variables injected successfully.
02:26:13 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
02:26:13 Run condition [Boolean condition] enabling perform for step [Execute shell]
02:26:13 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins11857691961683106513.sh
02:26:13 ---> Orphaned k8s clusters
02:26:13 Setup pyenv:
02:26:13 system
02:26:13 3.8.13
02:26:13 3.9.13
02:26:13 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
02:26:14 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CSBc from file:/tmp/.os_lf_venv
02:26:14 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:26:19 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient
02:27:02 lf-activate-venv(): INFO: Adding /tmp/venv-CSBc/bin to PATH
02:27:27 -----> Delete orphaned cluster
02:27:27 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
02:27:27 Run condition [Boolean condition] enabling perform for step [Execute shell]
02:27:27 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins11852746143549099785.sh
02:27:27 ---> Orphaned stacks
02:27:27 Setup pyenv:
02:27:27 system
02:27:27 3.8.13
02:27:27 3.9.13
02:27:27 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
02:27:28 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CSBc from file:/tmp/.os_lf_venv
02:27:28 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:27:35 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
02:28:40 lf-activate-venv(): INFO: Adding /tmp/venv-CSBc/bin to PATH
02:28:40 + mapfile -t OS_COE_CLUSTERS_ID
02:28:40 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
02:28:40 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
02:28:40 ++ awk '{print $1}'
02:28:55 + echo '-----> Active clusters -> stacks'
02:28:55 -----> Active clusters -> stacks
02:28:55 + OS_COE_STACKS=()
02:28:55 + [[ 0 -gt 0 ]]
02:28:55 + mapfile -t OS_STACKS
02:28:55 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
02:28:55 ++ awk '{print $1}'
02:29:09 + echo '-----> Active stacks'
02:29:09 -----> Active stacks
02:29:09 + echo '-----> Delete orphaned stacks'
02:29:09 -----> Delete orphaned stacks
02:29:09 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
02:29:09 Run condition [Boolean condition] enabling perform for step [Execute shell]
02:29:09 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins16913696633236775116.sh
02:29:09 ---> Orphaned servers
02:29:09 Setup pyenv:
02:29:09 system
02:29:09 3.8.13
02:29:09 3.9.13
02:29:09 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
02:29:09 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CSBc from file:/tmp/.os_lf_venv
02:29:09 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:29:16 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
02:30:20 lf-activate-venv(): INFO: Adding /tmp/venv-CSBc/bin to PATH
02:31:34 -----> Active servers
02:31:34 prd-ubuntu1804-docker-4c-4g-243
02:31:34 prd-ubuntu1804-docker-4c-4g-241
02:31:34 prd-ubuntu1804-docker-4c-4g-237
02:31:34 prd-ubuntu1804-docker-4c-4g-239
02:31:34 prd-ubuntu1804-docker-4c-4g-238
02:31:34 prd-centos8-builder-2c-4g-240
02:31:34 -----> Delete orphaned servers
02:31:54 Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-237
02:32:35 WARN: Server "prd-ubuntu1804-docker-4c-4g-237" is not older than 15 minutes.
02:32:42 Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-239
02:33:31 Build timed out (after 10 minutes). Marking the build as failed.
02:33:31 $ ssh-agent -k
02:33:31 unset SSH_AUTH_SOCK;
02:33:31 unset SSH_AGENT_PID;
02:33:31 echo Agent pid 5156 killed;
02:33:31 [ssh-agent] Stopped.
02:33:31 Build was aborted
02:33:31 [PostBuildScript] - [INFO] Executing post build scripts.
02:33:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins964927444714440177.sh
02:33:31 /tmp/jenkins16913696633236775116.sh: line 81: 6735 Terminated lftools openstack --os-cloud "$os_cloud" server remove --minutes 15 "$server"
02:33:31 ---> sysstat.sh
02:33:32 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7492881652398254325.sh
02:33:32 ---> package-listing.sh
02:33:32 ++ facter osfamily
02:33:32 ++ tr '[:upper:]' '[:lower:]'
02:33:33 + OS_FAMILY=redhat
02:33:33 + workspace=/w/workspace/ci-management-openstack-cron
02:33:33 + START_PACKAGES=/tmp/packages_start.txt
02:33:33 + END_PACKAGES=/tmp/packages_end.txt
02:33:33 + DIFF_PACKAGES=/tmp/packages_diff.txt
02:33:33 + PACKAGES=/tmp/packages_start.txt
02:33:33 + '[' /w/workspace/ci-management-openstack-cron ']'
02:33:33 + PACKAGES=/tmp/packages_end.txt
02:33:33 + case "${OS_FAMILY}" in
02:33:33 + rpm -qa
02:33:33 + sort
02:33:33 + '[' -f /tmp/packages_start.txt ']'
02:33:33 + '[' -f /tmp/packages_end.txt ']'
02:33:33 + diff /tmp/packages_start.txt /tmp/packages_end.txt
02:33:33 + '[' /w/workspace/ci-management-openstack-cron ']'
02:33:33 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
02:33:33 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
02:33:33 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins15604450600661371823.sh
02:33:33 ---> capture-instance-metadata.sh
02:33:33 Setup pyenv:
02:33:34 system
02:33:34 3.8.13
02:33:34 3.9.13
02:33:34 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
02:33:34 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CSBc from file:/tmp/.os_lf_venv
02:33:34 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:33:35 (23) Failed writing body
02:33:36 lf-activate-venv(): INFO: Installing additional packages: lftools
02:33:58 lf-activate-venv(): INFO: Adding /tmp/venv-CSBc/bin to PATH
02:33:58 INFO: Running in OpenStack, capturing instance metadata
02:34:22 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14967540265584725722.sh
02:34:22 provisioning config files...
02:34:22 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config11378991508264430071tmp
02:34:22 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
02:34:22 Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
02:34:22 [EnvInject] - Injecting environment variables from a build step.
02:34:22 [EnvInject] - Injecting as environment variables the properties content
02:34:22 SERVER_ID=logs
02:34:22
02:34:22 [EnvInject] - Variables injected successfully.
02:34:22 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14002692058746201115.sh
02:34:22 ---> create-netrc.sh
02:34:22 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1938051975519875445.sh
02:34:22 ---> python-tools-install.sh
02:34:22 Setup pyenv:
02:34:22 system
02:34:22 3.8.13
02:34:22 3.9.13
02:34:22 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
02:34:22 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CSBc from file:/tmp/.os_lf_venv
02:34:22 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:34:27 lf-activate-venv(): INFO: Installing additional packages: lftools
02:34:49 lf-activate-venv(): INFO: Adding /tmp/venv-CSBc/bin to PATH
02:34:49 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins8329066589392416025.sh
02:34:49 ---> uv-install.sh
02:34:49 uv 0.13.1 is already installed
02:34:49 uvx 0.13.1 (x86_64-unknown-linux-gnu)
02:34:49 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16989033431404211843.sh
02:34:49 ---> sudo-logs.sh
02:34:49 Archiving 'sudo' log..
02:34:49 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12725895795611131481.sh
02:34:49 ---> job-cost.sh
02:34:49 INFO: Activating Python virtual environment...
02:34:49 Setup pyenv:
02:34:49 system
02:34:49 3.8.13
02:34:49 3.9.13
02:34:49 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
02:34:49 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CSBc from file:/tmp/.os_lf_venv
02:34:49 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:34:56 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15
02:35:22 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:35:22 kubernetes 37.0.1 requires urllib3<3.0.0,>=2.8.0, but you have urllib3 1.26.20 which is incompatible.
02:35:22 kubernetes 37.0.1 requires urllib3>=2.8.0, but you have urllib3 1.26.20 which is incompatible.
02:35:22 lf-activate-venv(): INFO: Adding /tmp/venv-CSBc/bin to PATH
02:35:22 INFO: No stack-cost file found
02:35:22 INFO: Instance uptime: 794s
02:35:22 INFO: Fetching instance metadata (attempt 1 of 3)...
02:35:22 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
02:35:54 INFO: Successfully fetched instance metadata
02:35:54 INFO: Instance type: 504 Gateway Time-out
02:35:54 The server didn't respond in time.
02:35:54
02:35:54 INFO: Retrieving pricing info for: 504 Gateway Time-out
02:35:54 The server didn't respond in time.
02:35:54
02:35:54 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
02:35:54 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/504 Gateway Time-out
02:35:54 The server didn't respond in time.
02:35:54 /cost?seconds=794
02:35:54 ERROR: curl failed with exit code 3 for Vexxhost pricing API
02:35:54 ERROR: curl output: curl: (3) Illegal characters found in URL
02:35:54 INFO: Retrying in 10 seconds (exponential backoff)...
02:36:04 INFO: Fetching Vexxhost pricing API (attempt 2 of 3)...
02:36:04 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/504 Gateway Time-out
02:36:04 The server didn't respond in time.
02:36:04 /cost?seconds=794
02:36:04 ERROR: curl failed with exit code 3 for Vexxhost pricing API
02:36:04 ERROR: curl output: curl: (3) Illegal characters found in URL
02:36:04 INFO: Retrying in 20 seconds (exponential backoff)...
02:36:24 INFO: Fetching Vexxhost pricing API (attempt 3 of 3)...
02:36:24 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/504 Gateway Time-out
02:36:24 The server didn't respond in time.
02:36:24 /cost?seconds=794
02:36:24 ERROR: curl failed with exit code 3 for Vexxhost pricing API
02:36:24 ERROR: curl output: curl: (3) Illegal characters found in URL
02:36:24 ERROR: All 3 attempts failed for Vexxhost pricing API
02:36:24 ERROR: Failed to retrieve pricing information after 3 attempts
02:36:24 INFO: Continuing with default values: cost=0, resource=unknown
02:36:24 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost
02:36:24 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv
02:36:24 INFO: Successfully archived job cost data
02:36:24 DEBUG: Cost data: ci-management-openstack-cron,63159,2026-10-17 02:36:24,unknown,794,0.00,0.00,FAILURE
02:36:24 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins5783797537746099519.sh
02:36:24 ---> logs-deploy.sh
02:36:24 Setup pyenv:
02:36:24 system
02:36:24 3.8.13
02:36:24 3.9.13
02:36:24 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
02:36:25 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CSBc from file:/tmp/.os_lf_venv
02:36:25 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:36:32 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15
02:37:09 lf-activate-venv(): INFO: Adding /tmp/venv-CSBc/bin to PATH
02:37:09 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63159
02:37:09 INFO: archiving workspace using pattern(s):
02:37:13 Archives upload complete.
02:37:14 INFO: archiving logs to Nexus
02:37:14 ---> uname -a:
02:37:14 Linux prd-centos8-builder-2c-4g-240.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
02:37:14
02:37:14
02:37:14 ---> lscpu:
02:37:14 Architecture: x86_64
02:37:14 CPU op-mode(s): 32-bit, 64-bit
02:37:14 Byte Order: Little Endian
02:37:14 CPU(s): 2
02:37:14 On-line CPU(s) list: 0,1
02:37:14 Thread(s) per core: 1
02:37:14 Core(s) per socket: 1
02:37:14 Socket(s): 2
02:37:14 NUMA node(s): 1
02:37:14 Vendor ID: AuthenticAMD
02:37:14 CPU family: 23
02:37:14 Model: 49
02:37:14 Model name: AMD EPYC-Rome Processor
02:37:14 Stepping: 0
02:37:14 CPU MHz: 2800.000
02:37:14 BogoMIPS: 5600.00
02:37:14 Virtualization: AMD-V
02:37:14 Hypervisor vendor: KVM
02:37:14 Virtualization type: full
02:37:14 L1d cache: 32K
02:37:14 L1i cache: 32K
02:37:14 L2 cache: 512K
02:37:14 L3 cache: 16384K
02:37:14 NUMA node0 CPU(s): 0,1
02:37:14 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
02:37:14
02:37:14
02:37:14 ---> nproc:
02:37:14 2
02:37:14
02:37:14
02:37:14 ---> df -h:
02:37:14 Filesystem Size Used Avail Use% Mounted on
02:37:14 devtmpfs 1.8G 0 1.8G 0% /dev
02:37:14 tmpfs 1.8G 0 1.8G 0% /dev/shm
02:37:14 tmpfs 1.8G 17M 1.8G 1% /run
02:37:14 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup
02:37:14 /dev/vda1 20G 9.2G 11G 46% /
02:37:14 tmpfs 367M 0 367M 0% /run/user/1001
02:37:14
02:37:14
02:37:14 ---> free -m:
02:37:14 total used free shared buff/cache available
02:37:14 Mem: 3665 502 932 17 2231 2885
02:37:14 Swap: 1023 0 1023
02:37:14
02:37:14
02:37:14 ---> ip addr:
02:37:14 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
02:37:14 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
02:37:14 inet 127.0.0.1/8 scope host lo
02:37:14 valid_lft forever preferred_lft forever
02:37:14 inet6 ::1/128 scope host
02:37:14 valid_lft forever preferred_lft forever
02:37:14 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000
02:37:14 link/ether fa:16:3e:5b:eb:d0 brd ff:ff:ff:ff:ff:ff
02:37:14 altname enp0s3
02:37:14 altname ens3
02:37:14 inet 10.32.6.207/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
02:37:14 valid_lft 85525sec preferred_lft 85525sec
02:37:14 inet6 fe80::f816:3eff:fe5b:ebd0/64 scope link
02:37:14 valid_lft forever preferred_lft forever
02:37:14
02:37:14
02:37:14 ---> sar -b -r -n DEV:
02:37:14 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 10/17/2026 _x86_64_ (2 CPU)
02:37:14
02:37:14 02:22:16 LINUX RESTART (2 CPU)
02:37:14
02:37:14 02:23:01 AM tps rtps wtps bread/s bwrtn/s
02:37:14 02:24:01 AM 95.62 18.76 76.86 3984.01 37950.48
02:37:14 02:25:01 AM 39.20 0.20 39.00 29.99 3929.34
02:37:14 02:26:01 AM 54.54 0.03 54.51 0.53 8714.29
02:37:14 02:27:01 AM 31.13 0.70 30.43 201.50 6862.35
02:37:14 02:28:01 AM 25.01 0.55 24.46 66.92 5448.71
02:37:14 02:29:01 AM 18.34 0.05 18.29 1.33 2733.91
02:37:14 02:30:02 AM 27.49 0.00 27.49 0.00 4171.94
02:37:14 02:31:01 AM 18.69 0.00 18.69 0.00 5114.37
02:37:14 02:32:01 AM 2.92 0.80 2.12 51.86 123.03
02:37:14 02:33:01 AM 1.87 0.02 1.85 0.53 73.29
02:37:14 02:34:01 AM 18.16 10.36 7.80 357.81 229.18
02:37:14 02:35:01 AM 9.16 0.37 8.80 38.52 263.05
02:37:14 02:36:01 AM 16.71 0.03 16.68 1.33 907.03
02:37:14 02:37:01 AM 9.93 0.00 9.93 0.00 527.56
02:37:14 Average: 26.35 2.28 24.07 338.57 5504.17
02:37:14
02:37:14 02:23:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty
02:37:14 02:24:01 AM 1582284 3047544 2171392 57.85 2104 1644996 613384 12.77 129884 1793196 33324
02:37:14 02:25:01 AM 1385748 3029596 2367928 63.08 2104 1812556 598952 12.47 135240 1944356 135680
02:37:14 02:26:01 AM 1093600 2934792 2660076 70.87 2104 2001812 681064 14.18 136512 2204488 136396
02:37:14 02:27:01 AM 864148 2806428 2889528 76.98 2104 2099256 788720 16.42 138952 2409848 143816
02:37:14 02:28:01 AM 987192 2950036 2766484 73.70 2104 2122168 650088 13.54 149020 2290820 26796
02:37:14 02:29:01 AM 1027660 2976192 2726016 72.62 2104 2107132 627232 13.06 170840 2228736 96452
02:37:14 02:30:02 AM 909668 2907120 2844008 75.77 2104 2156612 694716 14.47 178056 2338396 39492
02:37:14 02:31:01 AM 985536 2968416 2768140 73.74 2104 2141360 627976 13.08 174608 2261704 4
02:37:14 02:32:01 AM 969700 2954120 2783976 74.17 2104 2142900 640116 13.33 176520 2277512 4
02:37:14 02:33:01 AM 969984 2954420 2783692 74.16 2104 2142916 644544 13.42 186464 2268280 4
02:37:14 02:34:01 AM 1024084 3019848 2729592 72.72 2104 2153760 578372 12.04 378796 2020976 5992
02:37:14 02:35:01 AM 990688 2990640 2762988 73.61 2104 2157792 609188 12.69 387012 2045636 8688
02:37:14 02:36:01 AM 1023664 3024332 2730012 72.73 2104 2158056 569644 11.86 385164 2013000 8
02:37:14 02:37:01 AM 947560 2949360 2806116 74.76 2104 2159580 653260 13.60 385252 2090072 120
02:37:14 Average: 1054394 2965203 2699282 71.91 2104 2071493 641233 13.35 222309 2156216 44770
02:37:14
02:37:14 02:23:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil
02:37:14 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:24:01 AM eth0 234.39 120.26 973.97 56.67 0.00 0.00 0.00 0.00
02:37:14 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:25:01 AM eth0 30.04 25.47 646.20 3.19 0.00 0.00 0.00 0.00
02:37:14 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:26:01 AM eth0 34.30 28.42 631.43 3.63 0.00 0.00 0.00 0.00
02:37:14 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:27:01 AM eth0 31.55 28.05 327.53 4.09 0.00 0.00 0.00 0.00
02:37:14 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:28:01 AM eth0 4.05 4.20 2.66 1.68 0.00 0.00 0.00 0.00
02:37:14 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:29:01 AM eth0 34.82 29.22 670.19 3.29 0.00 0.00 0.00 0.00
02:37:14 02:30:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:30:02 AM eth0 5.66 5.93 2.75 3.00 0.00 0.00 0.00 0.00
02:37:14 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:31:01 AM eth0 2.00 1.91 2.39 0.43 0.00 0.00 0.00 0.00
02:37:14 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:32:01 AM eth0 3.30 3.53 4.84 0.42 0.00 0.00 0.00 0.00
02:37:14 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:33:01 AM eth0 2.15 2.05 1.42 0.31 0.00 0.00 0.00 0.00
02:37:14 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:34:01 AM eth0 7.15 6.33 4.57 3.10 0.00 0.00 0.00 0.00
02:37:14 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:35:01 AM eth0 8.41 7.13 6.28 3.64 0.00 0.00 0.00 0.00
02:37:14 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:36:01 AM eth0 1.77 2.07 0.55 0.84 0.00 0.00 0.00 0.00
02:37:14 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 02:37:01 AM eth0 3.02 3.13 1.51 1.40 0.00 0.00 0.00 0.00
02:37:14 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:14 Average: eth0 28.79 19.14 234.31 6.13 0.00 0.00 0.00 0.00
02:37:14
02:37:14
02:37:14 ---> sar -P ALL:
02:37:14 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 10/17/2026 _x86_64_ (2 CPU)
02:37:14
02:37:14 02:22:16 LINUX RESTART (2 CPU)
02:37:14
02:37:14 02:23:01 AM CPU %user %nice %system %iowait %steal %idle
02:37:14 02:24:01 AM all 20.11 0.00 5.47 4.03 0.08 70.32
02:37:14 02:24:01 AM 0 21.61 0.00 5.36 1.98 0.08 70.97
02:37:14 02:24:01 AM 1 18.60 0.00 5.58 6.08 0.08 69.66
02:37:14 02:25:01 AM all 17.26 0.00 2.35 1.16 0.08 79.15
02:37:14 02:25:01 AM 0 13.59 0.00 1.92 1.55 0.07 82.87
02:37:14 02:25:01 AM 1 20.93 0.00 2.79 0.77 0.08 75.43
02:37:14 02:26:01 AM all 20.31 0.00 2.76 1.69 0.08 75.15
02:37:14 02:26:01 AM 0 6.86 0.00 1.67 1.12 0.07 90.29
02:37:14 02:26:01 AM 1 33.77 0.00 3.86 2.25 0.10 60.01
02:37:14 02:27:01 AM all 20.00 0.00 2.47 0.80 0.07 76.66
02:37:14 02:27:01 AM 0 8.47 0.00 2.17 1.44 0.05 87.87
02:37:14 02:27:01 AM 1 31.51 0.00 2.77 0.17 0.08 65.46
02:37:14 02:28:01 AM all 8.67 0.00 1.08 1.04 0.06 89.16
02:37:14 02:28:01 AM 0 8.66 0.00 1.00 1.04 0.07 89.24
02:37:14 02:28:01 AM 1 8.68 0.00 1.15 1.04 0.05 89.08
02:37:14 02:29:01 AM all 16.08 0.00 1.70 0.38 0.06 81.78
02:37:14 02:29:01 AM 0 13.15 0.00 1.64 0.22 0.05 84.95
02:37:14 02:29:01 AM 1 19.00 0.00 1.77 0.53 0.07 78.63
02:37:14 02:30:02 AM all 12.72 0.00 1.14 0.83 0.07 85.23
02:37:14 02:30:02 AM 0 6.33 0.00 1.04 0.67 0.07 91.90
02:37:14 02:30:02 AM 1 19.11 0.00 1.25 1.00 0.07 78.58
02:37:14 02:31:01 AM all 13.17 0.00 1.42 0.48 0.06 84.88
02:37:14 02:31:01 AM 0 11.05 0.00 0.97 0.44 0.07 87.47
02:37:14 02:31:01 AM 1 15.28 0.00 1.87 0.51 0.05 82.29
02:37:14 02:32:01 AM all 1.74 0.00 0.31 0.03 0.02 97.90
02:37:14 02:32:01 AM 0 0.59 0.00 0.20 0.00 0.02 99.20
02:37:14 02:32:01 AM 1 2.89 0.00 0.42 0.07 0.02 96.61
02:37:14 02:33:01 AM all 1.56 0.00 0.20 0.03 0.03 98.19
02:37:14 02:33:01 AM 0 2.14 0.00 0.27 0.00 0.03 97.56
02:37:14 02:33:01 AM 1 0.98 0.00 0.13 0.05 0.02 98.81
02:37:14 02:34:01 AM all 11.22 0.00 1.19 0.53 0.05 87.00
02:37:14 02:34:01 AM 0 7.27 0.00 1.22 1.02 0.03 90.46
02:37:14 02:34:01 AM 1 15.17 0.00 1.17 0.05 0.07 83.54
02:37:14
02:37:14 02:34:01 AM CPU %user %nice %system %iowait %steal %idle
02:37:14 02:35:01 AM all 12.72 0.00 1.45 0.07 0.07 85.70
02:37:14 02:35:01 AM 0 11.11 0.00 1.49 0.08 0.05 87.27
02:37:14 02:35:01 AM 1 14.32 0.00 1.42 0.05 0.08 84.13
02:37:14 02:36:01 AM all 5.70 0.00 0.61 0.50 0.03 93.15
02:37:14 02:36:01 AM 0 5.57 0.00 0.80 0.85 0.03 92.75
02:37:14 02:36:01 AM 1 5.84 0.00 0.42 0.15 0.03 93.56
02:37:14 02:37:01 AM all 9.08 0.00 0.93 0.32 2.21 87.46
02:37:14 02:37:01 AM 0 9.64 0.00 0.76 0.31 2.32 86.96
02:37:14 02:37:01 AM 1 8.52 0.00 1.09 0.33 2.10 87.95
02:37:14 Average: all 12.16 0.00 1.65 0.85 0.21 85.13
02:37:14 Average: 0 9.00 0.00 1.46 0.77 0.22 88.55
02:37:14 Average: 1 15.33 0.00 1.83 0.93 0.21 81.70
02:37:14
02:37:14
02:37:14