22:00:29 Started by timer 22:00:29 Running as SYSTEM 22:00:29 [EnvInject] - Loading node environment variables. 22:00:29 Building remotely on prd-centos8-builder-2c-4g-12251 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 22:00:29 [ssh-agent] Looking for ssh-agent implementation... 22:00:29 $ ssh-agent 22:00:29 SSH_AUTH_SOCK=/tmp/ssh-yn3wA2Ujmn7T/agent.5214 22:00:29 SSH_AGENT_PID=5216 22:00:29 [ssh-agent] Started. 22:00:29 Running ssh-add (command line suppressed) 22:00:29 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_12419676100224987686.key (jenkins-ssh) 22:00:29 [ssh-agent] Using credentials jenkins (jenkins) 22:00:29 The recommended git tool is: NONE 22:00:31 using credential jenkins 22:00:31 Wiping out workspace first. 22:00:31 Cloning the remote Git repository 22:00:31 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 22:00:31 > git init /w/workspace/ci-management-openstack-cron # timeout=10 22:00:31 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 22:00:31 > git --version # timeout=10 22:00:31 > git --version # 'git version 2.43.0' 22:00:31 using GIT_SSH to set credentials jenkins 22:00:31 [INFO] Currently running in a labeled security context 22:00:31 [INFO] Currently SELinux is 'enforcing' on the host 22:00:31 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh11574657277458742394.key 22:00:31 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 22:00:35 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 22:00:35 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 22:00:36 Avoid second fetch 22:00:36 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 22:00:36 Checking out Revision fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c (refs/remotes/origin/master) 22:00:36 > git config core.sparsecheckout # timeout=10 22:00:36 > git checkout -f fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10 22:00:36 Commit message: "Chore: Update global-jjb to v0.95.0" 22:00:36 > git rev-list --no-walk fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10 22:00:36 > git remote # timeout=10 22:00:36 > git submodule init # timeout=10 22:00:36 > git submodule sync # timeout=10 22:00:36 > git config --get remote.origin.url # timeout=10 22:00:36 > git submodule init # timeout=10 22:00:36 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 22:00:36 > git config --get submodule.packer/common-packer.url # timeout=10 22:00:36 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 22:00:36 > git config --get submodule.global-jjb.url # timeout=10 22:00:36 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 22:00:37 > git submodule update --init --recursive packer/common-packer # timeout=10 22:00:41 > git submodule update --init --recursive global-jjb # timeout=10 22:00:52 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:00:52 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:00:52 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:00:52 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:00:52 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:00:52 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:00:52 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 22:00:52 provisioning config files... 22:00:52 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 22:00:52 copy managed file [npmrc] to file:/home/jenkins/.npmrc 22:00:52 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 22:00:52 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2772682731759700393.sh 22:00:52 ---> python-tools-install.sh 22:00:52 Setup pyenv: 22:00:52 system 22:00:52 * 3.8.13 (set by /opt/pyenv/version) 22:00:52 * 3.9.13 (set by /opt/pyenv/version) 22:00:52 * 3.10.6 (set by /opt/pyenv/version) 22:00:57 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-PwHI 22:00:57 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 22:00:57 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:01:08 lf-activate-venv(): INFO: Installing additional packages: lftools 22:01:48 lf-activate-venv(): INFO: Adding /tmp/venv-PwHI/bin to PATH 22:01:48 Generating Requirements File 22:02:29 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 22:02:29 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 22:02:30 Python 3.10.6 22:02:30 pip 26.2.1 from /tmp/venv-PwHI/lib/python3.10/site-packages/pip (python 3.10) 22:02:30 aiohappyeyeballs==2.7.1 22:02:30 aiohttp==3.14.3 22:02:30 aiosignal==1.4.0 22:02:30 appdirs==1.4.4 22:02:30 argcomplete==3.7.2 22:02:30 aspy.yaml==1.3.0 22:02:30 async-timeout==5.0.1 22:02:30 attrs==26.1.0 22:02:30 autopage==0.6.0 22:02:30 backports.strenum==1.3.1 22:02:30 beautifulsoup4==4.15.0 22:02:30 boto3==1.43.93 22:02:30 botocore==1.43.93 22:02:30 bs4==0.0.2 22:02:30 certifi==2026.7.22 22:02:30 cffi==2.1.1 22:02:30 cfgv==3.5.0 22:02:30 chardet==7.6.0 22:02:30 charset-normalizer==3.5.1 22:02:30 click==8.5.0 22:02:30 cliff==4.14.0 22:02:30 cmd2==3.5.1 22:02:30 cryptography==3.3.2 22:02:30 debtcollector==3.1.0 22:02:30 decorator==5.3.1 22:02:30 defusedxml==0.7.1 22:02:30 Deprecated==1.3.1 22:02:30 distlib==0.4.3 22:02:30 dnspython==2.8.0 22:02:30 docker==7.2.0 22:02:30 dogpile.cache==1.5.0 22:02:30 durationpy==0.11 22:02:30 email-validator==2.3.0 22:02:30 filelock==3.32.6 22:02:30 frozenlist==1.8.0 22:02:30 future==1.0.0 22:02:30 gitdb==4.0.12 22:02:30 GitPython==3.1.62 22:02:30 httplib2==0.30.2 22:02:30 identify==2.6.19 22:02:30 idna==3.19 22:02:30 importlib-resources==1.5.0 22:02:30 iso8601==2.1.0 22:02:30 Jinja2==3.1.6 22:02:30 jmespath==1.1.0 22:02:30 jsonpatch==1.33 22:02:30 jsonpointer==3.1.1 22:02:30 jsonschema==4.26.0 22:02:30 jsonschema-specifications==2025.9.1 22:02:30 keystoneauth1==5.14.0 22:02:30 kubernetes==36.0.3 22:02:30 lftools==0.37.23 22:02:30 lxml==6.1.3 22:02:30 markdown-it-py==4.2.0 22:02:30 MarkupSafe==3.0.3 22:02:30 mdurl==0.1.2 22:02:30 msgpack==1.2.2 22:02:30 multi_key_dict==2.0.3 22:02:30 multidict==6.8.0 22:02:30 munch==4.0.0 22:02:30 netaddr==1.3.0 22:02:30 niet==1.4.2 22:02:30 nodeenv==1.10.0 22:02:30 oauth2client==4.1.3 22:02:30 oauthlib==3.3.1 22:02:30 openstacksdk==4.13.0 22:02:30 os-service-types==1.8.2 22:02:30 osc-lib==4.6.0 22:02:30 oslo.config==10.4.0 22:02:30 oslo.context==6.4.0 22:02:30 oslo.i18n==6.8.0 22:02:30 oslo.log==8.2.0 22:02:30 oslo.serialization==5.10.0 22:02:30 oslo.utils==10.1.1 22:02:30 packaging==26.3 22:02:30 pbr==7.0.3 22:02:30 platformdirs==4.11.8 22:02:30 prettytable==3.18.0 22:02:30 propcache==0.5.2 22:02:30 psutil==7.2.2 22:02:30 pyasn1==0.6.4 22:02:30 pyasn1_modules==0.4.2 22:02:30 pycparser==3.0 22:02:30 pygerrit2==2.0.15 22:02:30 PyGithub==2.10.0 22:02:30 Pygments==2.21.0 22:02:30 PyJWT==2.14.0 22:02:30 PyNaCl==1.6.2 22:02:30 pyparsing==2.4.7 22:02:30 pyperclip==1.11.0 22:02:30 pyrsistent==0.20.0 22:02:30 python-cinderclient==9.9.0 22:02:30 python-dateutil==2.9.0.post0 22:02:30 python-discovery==1.6.0 22:02:30 python-heatclient==5.2.0 22:02:30 python-jenkins==1.8.3 22:02:30 python-keystoneclient==6.0.0 22:02:30 python-magnumclient==4.11.0 22:02:30 python-openstackclient==10.0.0 22:02:30 python-swiftclient==4.11.0 22:02:30 PyYAML==6.0.3 22:02:30 referencing==0.37.0 22:02:30 requests==2.34.2 22:02:30 requests-oauthlib==2.0.0 22:02:30 rfc3986==2.0.0 22:02:30 rich==15.0.0 22:02:30 rich-argparse==1.8.0 22:02:30 rpds-py==0.30.0 22:02:30 rsa==4.9.1 22:02:30 ruamel.yaml==0.19.1 22:02:30 ruamel.yaml.clib==0.2.15 22:02:30 s3transfer==0.19.2 22:02:30 simplejson==4.1.2 22:02:30 six==1.17.0 22:02:30 smmap==5.0.3 22:02:30 soupsieve==2.9.2 22:02:30 stevedore==5.8.0 22:02:30 tabulate==0.10.0 22:02:30 toml==0.10.2 22:02:30 tomlkit==0.15.1 22:02:30 tqdm==4.70.1 22:02:30 typing_extensions==4.16.0 22:02:30 urllib3==1.26.20 22:02:30 virtualenv==21.7.9 22:02:30 wcwidth==0.8.3 22:02:30 websocket-client==1.9.2 22:02:30 wrapt==2.4.1 22:02:30 xdg==6.0.0 22:02:30 xmltodict==1.0.4 22:02:30 yarl==1.24.5 22:02:30 yq==4.1.2 22:02:30 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins5138883523628256971.sh 22:02:30 ---> uv-install.sh 22:02:30 Installing uv/uvx (latest) using shell installer 22:02:37 2026-09-12 22:02:37 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71308/71308] -> "/tmp/uv-install-UKYWVy.sh" [1] 22:02:37 downloading uv 0.12.13 x86_64-unknown-linux-gnu 22:02:41 installing to /home/jenkins/.local/bin 22:02:41 uv 22:02:41 uvx 22:02:41 everything's installed! 22:02:41 ---> Validating uv/uvx install 22:02:41 uvx 0.12.13 (x86_64-unknown-linux-gnu) 22:02:41 [EnvInject] - Injecting environment variables from a build step. 22:02:41 [EnvInject] - Injecting as environment variables the properties content 22:02:41 OS_CLOUD=vex 22:02:41 22:02:41 [EnvInject] - Variables injected successfully. 22:02:41 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 22:02:41 Run condition [Boolean condition] enabling perform for step [Execute shell] 22:02:41 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins112311791681610542.sh 22:02:41 ---> Orphaned k8s clusters 22:02:41 Setup pyenv: 22:02:41 system 22:02:41 3.8.13 22:02:41 3.9.13 22:02:41 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:02:42 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PwHI from file:/tmp/.os_lf_venv 22:02:42 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:02:44 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 22:02:58 lf-activate-venv(): INFO: Adding /tmp/venv-PwHI/bin to PATH 22:06:06 Gateway Timeout (HTTP 504) 22:06:06 -----> Delete orphaned cluster 22:06:06 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 22:06:06 Run condition [Boolean condition] enabling perform for step [Execute shell] 22:06:06 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3332045021558465316.sh 22:06:06 ---> Orphaned stacks 22:06:06 Setup pyenv: 22:06:06 system 22:06:06 3.8.13 22:06:06 3.9.13 22:06:06 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:06:06 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PwHI from file:/tmp/.os_lf_venv 22:06:06 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:06:12 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 22:06:37 lf-activate-venv(): INFO: Adding /tmp/venv-PwHI/bin to PATH 22:06:37 + mapfile -t OS_COE_CLUSTERS_ID 22:06:37 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 22:06:37 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 22:06:37 ++ awk '{print $1}' 22:06:47 + echo '-----> Active clusters -> stacks' 22:06:47 -----> Active clusters -> stacks 22:06:47 + OS_COE_STACKS=() 22:06:47 + [[ 0 -gt 0 ]] 22:06:47 + mapfile -t OS_STACKS 22:06:47 ++ awk '{print $1}' 22:06:47 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 22:08:55 + echo '-----> Active stacks' 22:08:55 -----> Active stacks 22:08:55 + echo '-----> Delete orphaned stacks' 22:08:55 -----> Delete orphaned stacks 22:08:55 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 22:08:55 Run condition [Boolean condition] enabling perform for step [Execute shell] 22:08:55 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3871551300982597029.sh 22:08:56 ---> Orphaned servers 22:08:56 Setup pyenv: 22:08:56 system 22:08:56 3.8.13 22:08:56 3.9.13 22:08:56 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:08:56 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PwHI from file:/tmp/.os_lf_venv 22:08:56 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:09:01 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 22:09:24 lf-activate-venv(): INFO: Adding /tmp/venv-PwHI/bin to PATH 22:09:38 -----> Active servers 22:09:38 prd-ubuntu1804-docker-4c-4g-12261 22:09:38 prd-ubuntu1804-builder-4c-4g-12260 22:09:38 prd-centos7-docker-2c-8g-12259 22:09:38 prd-centos7-docker-2c-8g-12253 22:09:38 prd-ubuntu1804-builder-4c-4g-12258 22:09:38 prd-centos7-docker-2c-8g-12256 22:09:38 prd-ubuntu1804-docker-4c-4g-12252 22:09:38 prd-centos8-builder-2c-4g-12251 22:09:38 prd-ubuntu1804-builder-4c-4g-12248 22:09:38 prd-ubuntu1804-docker-4c-4g-12249 22:09:38 prd-centos7-docker-2c-8g-12237 22:09:38 prd-ubuntu1804-docker-4c-4g-12245 22:09:38 prd-ubuntu1804-docker-4c-4g-12225 22:09:38 -----> Delete orphaned servers 22:09:45 Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-12261 22:10:37 WARN: Server "prd-ubuntu1804-docker-4c-4g-12261" is not older than 15 minutes. 22:10:44 Deleting orphaned server: prd-ubuntu1804-builder-4c-4g-12260 22:10:52 Build timed out (after 10 minutes). Marking the build as failed. 22:10:52 $ ssh-agent -k 22:10:52 unset SSH_AUTH_SOCK; 22:10:52 unset SSH_AGENT_PID; 22:10:52 echo Agent pid 5216 killed; 22:10:52 [ssh-agent] Stopped. 22:10:52 Build was aborted 22:10:52 [PostBuildScript] - [INFO] Executing post build scripts. 22:10:52 /tmp/jenkins3871551300982597029.sh: line 81: 6760 Terminated lftools openstack --os-cloud "$os_cloud" server remove --minutes 15 "$server" 22:10:52 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10549726003921056965.sh 22:10:52 ---> sysstat.sh 22:10:52 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins15505977329734141807.sh 22:10:52 ---> package-listing.sh 22:10:52 ++ facter osfamily 22:10:52 ++ tr '[:upper:]' '[:lower:]' 22:10:52 + OS_FAMILY=redhat 22:10:52 + workspace=/w/workspace/ci-management-openstack-cron 22:10:52 + START_PACKAGES=/tmp/packages_start.txt 22:10:52 + END_PACKAGES=/tmp/packages_end.txt 22:10:52 + DIFF_PACKAGES=/tmp/packages_diff.txt 22:10:52 + PACKAGES=/tmp/packages_start.txt 22:10:52 + '[' /w/workspace/ci-management-openstack-cron ']' 22:10:52 + PACKAGES=/tmp/packages_end.txt 22:10:52 + case "${OS_FAMILY}" in 22:10:52 + rpm -qa 22:10:52 + sort 22:10:52 (23) Failed writing body 22:10:53 + '[' -f /tmp/packages_start.txt ']' 22:10:53 + '[' -f /tmp/packages_end.txt ']' 22:10:53 + diff /tmp/packages_start.txt /tmp/packages_end.txt 22:10:53 + '[' /w/workspace/ci-management-openstack-cron ']' 22:10:53 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 22:10:53 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 22:10:53 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14847830809960400661.sh 22:10:53 ---> capture-instance-metadata.sh 22:10:53 Setup pyenv: 22:10:53 system 22:10:53 3.8.13 22:10:53 3.9.13 22:10:53 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:10:53 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PwHI from file:/tmp/.os_lf_venv 22:10:53 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:10:59 lf-activate-venv(): INFO: Installing additional packages: lftools 22:11:14 lf-activate-venv(): INFO: Adding /tmp/venv-PwHI/bin to PATH 22:11:14 INFO: Running in OpenStack, capturing instance metadata 22:11:14 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10669275396868517291.sh 22:11:14 provisioning config files... 22:11:14 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config14922820509828951631tmp 22:11:14 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 22:11:14 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 22:11:14 [EnvInject] - Injecting environment variables from a build step. 22:11:14 [EnvInject] - Injecting as environment variables the properties content 22:11:14 SERVER_ID=logs 22:11:14 22:11:14 [EnvInject] - Variables injected successfully. 22:11:14 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11600334254022105415.sh 22:11:14 ---> create-netrc.sh 22:11:14 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10389127691649603650.sh 22:11:14 ---> python-tools-install.sh 22:11:14 Setup pyenv: 22:11:14 system 22:11:14 3.8.13 22:11:14 3.9.13 22:11:14 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:11:15 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PwHI from file:/tmp/.os_lf_venv 22:11:15 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:11:20 lf-activate-venv(): INFO: Installing additional packages: lftools 22:11:35 lf-activate-venv(): INFO: Adding /tmp/venv-PwHI/bin to PATH 22:11:35 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins7988228703510538269.sh 22:11:35 ---> uv-install.sh 22:11:35 uv 0.12.13 is already installed 22:11:35 uvx 0.12.13 (x86_64-unknown-linux-gnu) 22:11:35 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14600490196466276426.sh 22:11:35 ---> sudo-logs.sh 22:11:35 Archiving 'sudo' log.. 22:11:35 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins5736474869933685776.sh 22:11:35 ---> job-cost.sh 22:11:35 INFO: Activating Python virtual environment... 22:11:35 Setup pyenv: 22:11:35 system 22:11:35 3.8.13 22:11:35 3.9.13 22:11:35 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:11:35 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PwHI from file:/tmp/.os_lf_venv 22:11:35 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:11:40 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 22:11:52 lf-activate-venv(): INFO: Adding /tmp/venv-PwHI/bin to PATH 22:11:52 INFO: No stack-cost file found 22:11:52 INFO: Instance uptime: 743s 22:11:52 INFO: Fetching instance metadata (attempt 1 of 3)... 22:11:52 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 22:11:53 INFO: Successfully fetched instance metadata 22:11:53 INFO: Instance type: v3-starter-2 22:11:53 INFO: Retrieving pricing info for: v3-starter-2 22:11:53 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 22:11:53 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=743 22:11:56 INFO: Successfully fetched Vexxhost pricing API 22:11:56 INFO: Retrieved cost: 0.02 22:11:56 INFO: Retrieved resource: v3-starter-2 22:11:56 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 22:11:56 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 22:11:56 INFO: Successfully archived job cost data 22:11:56 DEBUG: Cost data: ci-management-openstack-cron,62338,2026-09-12 22:11:56,v3-starter-2,743,0.02,0.00,FAILURE 22:11:56 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins9908983337854006059.sh 22:11:56 ---> logs-deploy.sh 22:11:56 Setup pyenv: 22:11:56 system 22:11:56 3.8.13 22:11:56 3.9.13 22:11:56 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:11:56 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PwHI from file:/tmp/.os_lf_venv 22:11:56 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:12:01 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 22:12:17 lf-activate-venv(): INFO: Adding /tmp/venv-PwHI/bin to PATH 22:12:17 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/62338 22:12:17 INFO: archiving workspace using pattern(s): 22:12:18 Archives upload complete. 22:12:19 INFO: archiving logs to Nexus 22:12:20 ---> uname -a: 22:12:20 Linux prd-centos8-builder-2c-4g-12251.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 22:12:20 22:12:20 22:12:20 ---> lscpu: 22:12:20 Architecture: x86_64 22:12:20 CPU op-mode(s): 32-bit, 64-bit 22:12:20 Byte Order: Little Endian 22:12:20 CPU(s): 2 22:12:20 On-line CPU(s) list: 0,1 22:12:20 Thread(s) per core: 1 22:12:20 Core(s) per socket: 1 22:12:20 Socket(s): 2 22:12:20 NUMA node(s): 1 22:12:20 Vendor ID: AuthenticAMD 22:12:20 CPU family: 23 22:12:20 Model: 49 22:12:20 Model name: AMD EPYC-Rome Processor 22:12:20 Stepping: 0 22:12:20 CPU MHz: 2799.998 22:12:20 BogoMIPS: 5599.99 22:12:20 Virtualization: AMD-V 22:12:20 Hypervisor vendor: KVM 22:12:20 Virtualization type: full 22:12:20 L1d cache: 32K 22:12:20 L1i cache: 32K 22:12:20 L2 cache: 512K 22:12:20 L3 cache: 16384K 22:12:20 NUMA node0 CPU(s): 0,1 22:12:20 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 22:12:20 22:12:20 22:12:20 ---> nproc: 22:12:20 2 22:12:20 22:12:20 22:12:20 ---> df -h: 22:12:20 Filesystem Size Used Avail Use% Mounted on 22:12:20 devtmpfs 1.8G 0 1.8G 0% /dev 22:12:20 tmpfs 1.8G 0 1.8G 0% /dev/shm 22:12:20 tmpfs 1.8G 17M 1.8G 1% /run 22:12:20 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 22:12:20 /dev/vda1 20G 9.2G 11G 46% / 22:12:20 tmpfs 367M 0 367M 0% /run/user/1001 22:12:20 22:12:20 22:12:20 ---> free -m: 22:12:20 total used free shared buff/cache available 22:12:20 Mem: 3665 508 987 17 2169 2879 22:12:20 Swap: 1023 0 1023 22:12:20 22:12:20 22:12:20 ---> ip addr: 22:12:20 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 22:12:20 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 22:12:20 inet 127.0.0.1/8 scope host lo 22:12:20 valid_lft forever preferred_lft forever 22:12:20 inet6 ::1/128 scope host 22:12:20 valid_lft forever preferred_lft forever 22:12:20 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 22:12:20 link/ether fa:16:3e:70:37:d1 brd ff:ff:ff:ff:ff:ff 22:12:20 altname enp0s3 22:12:20 altname ens3 22:12:20 inet 10.32.6.243/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 22:12:20 valid_lft 85661sec preferred_lft 85661sec 22:12:20 inet6 fe80::f816:3eff:fe70:37d1/64 scope link 22:12:20 valid_lft forever preferred_lft forever 22:12:20 22:12:20 22:12:20 ---> sar -b -r -n DEV: 22:12:20 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 09/12/2026 _x86_64_ (2 CPU) 22:12:20 22:12:20 21:59:37 LINUX RESTART (2 CPU) 22:12:20 22:12:20 10:00:00 PM tps rtps wtps bread/s bwrtn/s 22:12:20 10:01:01 PM 191.67 123.39 68.28 14633.61 37469.44 22:12:20 10:02:01 PM 51.77 0.45 51.32 35.85 4686.29 22:12:20 10:03:01 PM 64.27 1.24 63.03 238.29 10726.06 22:12:20 10:04:01 PM 18.01 0.03 17.98 0.53 3929.15 22:12:20 10:05:01 PM 1.43 0.00 1.43 0.00 45.50 22:12:20 10:06:01 PM 0.17 0.00 0.17 0.00 2.07 22:12:20 10:07:01 PM 13.33 0.05 13.28 1.33 1611.76 22:12:20 10:08:01 PM 10.53 0.00 10.53 0.00 798.02 22:12:20 10:09:01 PM 0.57 0.00 0.57 0.00 46.34 22:12:20 10:10:01 PM 16.24 0.80 15.44 51.85 530.47 22:12:20 10:11:01 PM 4.23 0.08 4.15 10.26 160.15 22:12:20 10:12:01 PM 18.96 0.38 18.58 38.65 593.54 22:12:20 Average: 32.98 10.85 22.13 1287.94 5128.48 22:12:20 22:12:20 10:00:00 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 22:12:20 10:01:01 PM 1566128 3031800 2187556 58.28 2104 1645324 624708 13.01 136168 1804680 47268 22:12:20 10:02:01 PM 1345288 3004848 2408396 64.16 2104 1827632 611784 12.74 143840 1975248 140252 22:12:20 10:03:01 PM 1067340 2959124 2686344 71.57 2104 2050916 629996 13.12 146440 2213792 105596 22:12:20 10:04:01 PM 1063988 2955616 2689696 71.65 2104 2050932 629996 13.12 146764 2216320 16 22:12:20 10:05:01 PM 1064000 2955628 2689684 71.65 2104 2050932 629996 13.12 146764 2216324 4 22:12:20 10:06:01 PM 1064056 2955688 2689628 71.65 2104 2050936 637544 13.28 146764 2216476 4 22:12:20 10:07:01 PM 1032456 2963984 2721228 72.49 2104 2090012 628456 13.09 171224 2221592 19420 22:12:20 10:08:01 PM 1032364 2963420 2721320 72.50 2104 2090012 628456 13.09 171220 2221608 4 22:12:20 10:09:01 PM 1028652 2967080 2725032 72.60 2104 2097420 618592 12.88 173076 2224484 6204 22:12:20 10:10:01 PM 1009840 2942636 2743844 73.10 2104 2091540 648900 13.51 176548 2238916 4 22:12:20 10:11:01 PM 1053724 2988536 2699960 71.93 2104 2093536 605580 12.61 371144 2001060 7524 22:12:20 10:12:01 PM 1032416 2974676 2721268 72.50 2104 2100408 626212 13.04 379500 2013692 23408 22:12:20 Average: 1113354 2971920 2640330 70.34 2104 2019967 626685 13.05 192454 2130349 29142 22:12:20 22:12:20 10:00:00 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 22:12:20 10:01:01 PM lo 0.03 0.03 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:01:01 PM eth0 209.65 112.09 938.44 54.06 0.00 0.00 0.00 0.00 22:12:20 10:02:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:02:01 PM eth0 38.30 34.67 779.82 4.53 0.00 0.00 0.00 0.00 22:12:20 10:03:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:03:01 PM eth0 48.71 45.61 602.00 6.69 0.00 0.00 0.00 0.00 22:12:20 10:04:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:04:01 PM eth0 0.78 0.70 0.68 0.09 0.00 0.00 0.00 0.00 22:12:20 10:05:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:05:01 PM eth0 0.13 0.13 0.01 0.01 0.00 0.00 0.00 0.00 22:12:20 10:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:06:01 PM eth0 5.07 2.98 5.00 0.25 0.00 0.00 0.00 0.00 22:12:20 10:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:07:01 PM eth0 36.85 33.16 650.35 4.78 0.00 0.00 0.00 0.00 22:12:20 10:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:08:01 PM eth0 0.15 0.15 0.01 0.01 0.00 0.00 0.00 0.00 22:12:20 10:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:09:01 PM eth0 1.32 1.12 0.87 0.44 0.00 0.00 0.00 0.00 22:12:20 10:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:10:01 PM eth0 7.51 8.65 8.79 2.96 0.00 0.00 0.00 0.00 22:12:20 10:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:11:01 PM eth0 6.20 4.86 4.57 2.01 0.00 0.00 0.00 0.00 22:12:20 10:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 10:12:01 PM eth0 12.76 12.85 8.56 6.17 0.00 0.00 0.00 0.00 22:12:20 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:12:20 Average: eth0 31.07 21.62 251.29 6.96 0.00 0.00 0.00 0.00 22:12:20 22:12:20 22:12:20 ---> sar -P ALL: 22:12:20 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 09/12/2026 _x86_64_ (2 CPU) 22:12:20 22:12:20 21:59:37 LINUX RESTART (2 CPU) 22:12:20 22:12:20 10:00:00 PM CPU %user %nice %system %iowait %steal %idle 22:12:20 10:01:01 PM all 30.94 0.00 11.23 8.63 0.11 49.08 22:12:20 10:01:01 PM 0 25.89 0.00 11.84 12.92 0.10 49.25 22:12:20 10:01:01 PM 1 35.99 0.00 10.62 4.36 0.11 48.92 22:12:20 10:02:01 PM all 22.40 0.00 3.03 0.93 0.08 73.56 22:12:20 10:02:01 PM 0 33.91 0.00 4.06 0.83 0.10 61.09 22:12:20 10:02:01 PM 1 10.87 0.00 1.99 1.02 0.07 86.06 22:12:20 10:03:01 PM all 28.61 0.00 3.56 2.12 0.10 65.61 22:12:20 10:03:01 PM 0 27.76 0.00 3.20 1.85 0.10 67.10 22:12:20 10:03:01 PM 1 29.48 0.00 3.91 2.40 0.10 64.11 22:12:20 10:04:01 PM all 0.42 0.00 0.26 0.60 0.01 98.71 22:12:20 10:04:01 PM 0 0.23 0.00 0.28 0.77 0.00 98.72 22:12:20 10:04:01 PM 1 0.60 0.00 0.23 0.44 0.02 98.71 22:12:20 10:05:01 PM all 0.33 0.00 0.07 0.00 0.03 99.58 22:12:20 10:05:01 PM 0 0.03 0.00 0.05 0.00 0.02 99.90 22:12:20 10:05:01 PM 1 0.62 0.00 0.08 0.00 0.03 99.26 22:12:20 10:06:01 PM all 0.36 0.00 0.08 0.00 0.01 99.56 22:12:20 10:06:01 PM 0 0.10 0.00 0.08 0.00 0.00 99.82 22:12:20 10:06:01 PM 1 0.62 0.00 0.07 0.00 0.02 99.30 22:12:20 10:07:01 PM all 18.14 0.00 1.59 0.17 0.05 80.06 22:12:20 10:07:01 PM 0 30.50 0.00 2.27 0.10 0.07 67.06 22:12:20 10:07:01 PM 1 5.75 0.00 0.90 0.23 0.03 93.08 22:12:20 10:08:01 PM all 0.32 0.00 0.13 0.45 0.02 99.09 22:12:20 10:08:01 PM 0 0.58 0.00 0.17 0.75 0.02 98.48 22:12:20 10:08:01 PM 1 0.05 0.00 0.08 0.15 0.02 99.70 22:12:20 10:09:01 PM all 1.93 0.00 0.46 0.00 0.05 97.56 22:12:20 10:09:01 PM 0 2.87 0.00 0.43 0.00 0.03 96.67 22:12:20 10:09:01 PM 1 0.99 0.00 0.48 0.00 0.07 98.46 22:12:20 10:10:01 PM all 16.37 0.00 0.92 0.39 0.06 82.26 22:12:20 10:10:01 PM 0 24.72 0.00 1.05 0.63 0.07 73.52 22:12:20 10:10:01 PM 1 7.99 0.00 0.79 0.15 0.05 91.02 22:12:20 10:11:01 PM all 4.45 0.00 1.01 0.17 0.03 94.35 22:12:20 10:11:01 PM 0 7.22 0.00 1.35 0.00 0.02 91.41 22:12:20 10:11:01 PM 1 1.67 0.00 0.67 0.33 0.03 97.29 22:12:20 22:12:20 10:11:01 PM CPU %user %nice %system %iowait %steal %idle 22:12:20 10:12:01 PM all 26.63 0.00 2.59 0.29 0.08 70.41 22:12:20 10:12:01 PM 0 42.40 0.00 2.80 0.28 0.10 54.42 22:12:20 10:12:01 PM 1 10.82 0.00 2.39 0.30 0.05 86.44 22:12:20 Average: all 12.59 0.00 2.09 1.16 0.05 84.10 22:12:20 Average: 0 16.36 0.00 2.32 1.53 0.05 79.74 22:12:20 Average: 1 8.82 0.00 1.87 0.79 0.05 88.47 22:12:20 22:12:20 22:12:20