09:04:36 Started by timer 09:04:36 Running as SYSTEM 09:04:36 [EnvInject] - Loading node environment variables. 09:04:36 Building remotely on prd-centos8-builder-2c-4g-2224 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 09:04:36 [ssh-agent] Looking for ssh-agent implementation... 09:04:36 $ ssh-agent 09:04:36 SSH_AUTH_SOCK=/tmp/ssh-XVhIvulozLwk/agent.5168 09:04:36 SSH_AGENT_PID=5170 09:04:36 [ssh-agent] Started. 09:04:36 Running ssh-add (command line suppressed) 09:04:36 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_13586445214361807660.key (jenkins-ssh) 09:04:36 [ssh-agent] Using credentials jenkins (jenkins) 09:04:36 The recommended git tool is: NONE 09:04:38 using credential jenkins 09:04:38 Wiping out workspace first. 09:04:38 Cloning the remote Git repository 09:04:38 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 09:04:38 > git init /w/workspace/ci-management-openstack-cron # timeout=10 09:04:39 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 09:04:39 > git --version # timeout=10 09:04:39 > git --version # 'git version 2.43.0' 09:04:39 using GIT_SSH to set credentials jenkins 09:04:39 [INFO] Currently running in a labeled security context 09:04:39 [INFO] Currently SELinux is 'enforcing' on the host 09:04:39 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh16175167886803458974.key 09:04:39 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 09:04:42 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 09:04:43 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 09:04:43 Avoid second fetch 09:04:43 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 09:04:43 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 09:04:43 > git config core.sparsecheckout # timeout=10 09:04:43 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 09:04:43 Commit message: "CI: Update github2gerrit caller to v2.4.4" 09:04:43 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 09:04:43 > git remote # timeout=10 09:04:43 > git submodule init # timeout=10 09:04:43 > git submodule sync # timeout=10 09:04:44 > git config --get remote.origin.url # timeout=10 09:04:44 > git submodule init # timeout=10 09:04:44 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 09:04:44 > git config --get submodule.packer/common-packer.url # timeout=10 09:04:44 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 09:04:44 > git config --get submodule.global-jjb.url # timeout=10 09:04:44 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 09:04:44 > git submodule update --init --recursive packer/common-packer # timeout=10 09:04:48 > git submodule update --init --recursive global-jjb # timeout=10 09:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 09:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 09:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 09:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 09:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 09:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 09:04:58 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 09:04:58 provisioning config files... 09:04:58 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 09:04:59 copy managed file [npmrc] to file:/home/jenkins/.npmrc 09:04:59 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 09:04:59 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2680658609895137072.sh 09:04:59 ---> python-tools-install.sh 09:04:59 Setup pyenv: 09:04:59 system 09:04:59 * 3.8.13 (set by /opt/pyenv/version) 09:04:59 * 3.9.13 (set by /opt/pyenv/version) 09:04:59 * 3.10.6 (set by /opt/pyenv/version) 09:05:03 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-A1Iv 09:05:03 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 09:05:03 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:05:15 lf-activate-venv(): INFO: Installing additional packages: lftools 09:05:51 lf-activate-venv(): INFO: Adding /tmp/venv-A1Iv/bin to PATH 09:05:51 Generating Requirements File 09:06:34 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 09:06:34 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 09:06:34 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 09:06:35 Python 3.10.6 09:06:35 pip 26.3 from /tmp/venv-A1Iv/lib/python3.10/site-packages/pip (python 3.10) 09:06:35 aiohappyeyeballs==2.7.1 09:06:35 aiohttp==3.14.5 09:06:35 aiosignal==1.4.0 09:06:35 appdirs==1.4.4 09:06:35 argcomplete==3.7.2 09:06:35 aspy.yaml==1.3.0 09:06:35 async-timeout==5.0.1 09:06:35 attrs==26.1.0 09:06:35 autopage==0.6.0 09:06:35 backports.strenum==1.3.1 09:06:35 beautifulsoup4==4.15.0 09:06:35 boto3==1.43.126 09:06:35 botocore==1.43.126 09:06:35 bs4==0.0.2 09:06:35 certifi==2026.10.23 09:06:35 cffi==2.1.1 09:06:35 cfgv==3.5.0 09:06:35 chardet==7.7.0 09:06:35 charset-normalizer==3.5.2 09:06:35 click==8.5.1 09:06:35 cliff==4.14.0 09:06:35 cmd2==3.5.1 09:06:35 cryptography==3.3.2 09:06:35 debtcollector==3.1.0 09:06:35 decorator==5.3.1 09:06:35 defusedxml==0.7.1 09:06:35 Deprecated==1.3.1 09:06:35 distlib==0.4.4 09:06:35 dnspython==2.8.0 09:06:35 docker==7.2.0 09:06:35 dogpile.cache==1.5.0 09:06:35 durationpy==0.11 09:06:35 email-validator==2.3.0 09:06:35 filelock==4.1.0 09:06:35 frozenlist==1.8.0 09:06:35 future==1.0.0 09:06:35 gitdb==4.0.12 09:06:35 GitPython==3.2.1 09:06:35 httplib2==0.30.2 09:06:35 identify==2.6.20 09:06:35 idna==3.20 09:06:35 importlib-resources==1.5.0 09:06:35 iso8601==2.1.0 09:06:35 Jinja2==3.1.6 09:06:35 jmespath==1.1.0 09:06:35 jsonpatch==1.44 09:06:35 jsonpointer==3.10 09:06:35 jsonschema==4.26.0 09:06:35 jsonschema-specifications==2025.9.1 09:06:35 keystoneauth1==5.14.0 09:06:35 kubernetes==36.0.3 09:06:35 lftools==0.37.26 09:06:35 lxml==6.1.3 09:06:35 markdown-it-py==4.2.0 09:06:35 MarkupSafe==3.0.4 09:06:35 mdurl==0.1.2 09:06:35 msgpack==1.2.4 09:06:35 multi_key_dict==2.0.4 09:06:35 multidict==7.1.0 09:06:35 munch==4.0.0 09:06:35 netaddr==1.3.0 09:06:35 niet==1.4.2 09:06:35 nodeenv==1.12.0 09:06:35 oauth2client==4.1.3 09:06:35 oauthlib==4.0.1 09:06:35 openstacksdk==4.13.0 09:06:35 os-service-types==1.8.2 09:06:35 osc-lib==4.6.0 09:06:35 oslo.config==10.4.0 09:06:35 oslo.context==6.4.0 09:06:35 oslo.i18n==6.8.0 09:06:35 oslo.log==8.2.0 09:06:35 oslo.serialization==5.10.0 09:06:35 oslo.utils==10.1.1 09:06:35 packaging==26.3 09:06:35 pbr==7.1.3 09:06:35 platformdirs==4.12.4 09:06:35 prettytable==3.18.0 09:06:35 propcache==0.5.4 09:06:35 psutil==7.2.2 09:06:35 pyasn1==0.6.5 09:06:35 pyasn1_modules==0.4.2 09:06:35 pycparser==3.11 09:06:35 pygerrit2==2.0.15 09:06:35 PyGithub==2.10.0 09:06:35 Pygments==2.21.0 09:06:35 PyJWT==2.15.1 09:06:35 PyNaCl==1.6.2 09:06:35 pyparsing==2.4.7 09:06:35 pyperclip==1.11.0 09:06:35 pyrsistent==0.20.0 09:06:35 python-cinderclient==9.9.0 09:06:35 python-dateutil==3.0.0 09:06:35 python-discovery==1.9.5 09:06:35 python-heatclient==5.2.0 09:06:35 python-jenkins==1.8.3 09:06:35 python-keystoneclient==6.0.0 09:06:35 python-magnumclient==4.11.0 09:06:35 python-openstackclient==10.0.0 09:06:35 python-swiftclient==4.11.0 09:06:35 PyYAML==6.0.3 09:06:35 referencing==0.37.0 09:06:35 requests==2.34.2 09:06:35 requests-oauthlib==2.0.0 09:06:35 rfc3986==2.0.0 09:06:35 rich==15.0.0 09:06:35 rich-argparse==1.8.0 09:06:35 rpds-py==0.30.0 09:06:35 rsa==4.9.1 09:06:35 ruamel.yaml==0.19.1 09:06:35 ruamel.yaml.clib==0.2.15 09:06:35 s3transfer==0.19.3 09:06:35 simplejson==4.2.0 09:06:35 six==1.17.0 09:06:35 smmap==5.0.3 09:06:35 soupsieve==2.10 09:06:35 stevedore==5.8.0 09:06:35 tabulate==0.10.0 09:06:35 toml==0.10.2 09:06:35 tomlkit==0.15.2 09:06:35 tqdm==4.70.1 09:06:35 typing_extensions==4.16.0 09:06:35 tzdata==2026.6 09:06:35 urllib3==1.26.20 09:06:35 virtualenv==21.15.6 09:06:35 wcwidth==0.9.4 09:06:35 websocket-client==1.9.2 09:06:35 wrapt==2.5.2 09:06:35 xdg==6.0.0 09:06:35 xmltodict==1.0.4 09:06:35 yarl==1.25.1 09:06:35 yq==4.4.5 09:06:35 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins9744643967327819055.sh 09:06:35 ---> uv-install.sh 09:06:35 Installing uv/uvx (latest) using shell installer 09:06:42 2026-11-08 09:06:42 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-jYx80G.sh" [1] 09:06:42 downloading uv 0.13.7 x86_64-unknown-linux-gnu 09:06:46 installing to /home/jenkins/.local/bin 09:06:46 uv 09:06:46 uvx 09:06:46 everything's installed! 09:06:46 ---> Validating uv/uvx install 09:06:46 uvx 0.13.7 (x86_64-unknown-linux-gnu) 09:06:46 [EnvInject] - Injecting environment variables from a build step. 09:06:46 [EnvInject] - Injecting as environment variables the properties content 09:06:46 OS_CLOUD=vex 09:06:46 09:06:46 [EnvInject] - Variables injected successfully. 09:06:46 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 09:06:46 Run condition [Boolean condition] enabling perform for step [Execute shell] 09:06:46 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins11290575471602380226.sh 09:06:46 ---> Orphaned k8s clusters 09:06:46 Setup pyenv: 09:06:46 system 09:06:46 3.8.13 09:06:46 3.9.13 09:06:46 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 09:06:47 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A1Iv from file:/tmp/.os_lf_venv 09:06:47 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:06:52 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 09:07:18 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 09:07:18 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 09:07:19 lf-activate-venv(): INFO: Adding /tmp/venv-A1Iv/bin to PATH 09:07:29 -----> Delete orphaned cluster 09:07:29 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 09:07:29 Run condition [Boolean condition] enabling perform for step [Execute shell] 09:07:29 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7074939662521199333.sh 09:07:29 ---> Orphaned stacks 09:07:29 Setup pyenv: 09:07:29 system 09:07:29 3.8.13 09:07:29 3.9.13 09:07:29 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 09:07:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A1Iv from file:/tmp/.os_lf_venv 09:07:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:07:35 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 09:08:07 lf-activate-venv(): INFO: Adding /tmp/venv-A1Iv/bin to PATH 09:08:07 + mapfile -t OS_COE_CLUSTERS_ID 09:08:07 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 09:08:07 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 09:08:07 ++ awk '{print $1}' 09:08:16 + echo '-----> Active clusters -> stacks' 09:08:16 -----> Active clusters -> stacks 09:08:16 + OS_COE_STACKS=() 09:08:16 + [[ 0 -gt 0 ]] 09:08:16 + mapfile -t OS_STACKS 09:08:16 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 09:08:16 ++ awk '{print $1}' 09:08:25 + echo '-----> Active stacks' 09:08:25 -----> Active stacks 09:08:25 + echo '-----> Delete orphaned stacks' 09:08:25 -----> Delete orphaned stacks 09:08:25 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 09:08:25 Run condition [Boolean condition] enabling perform for step [Execute shell] 09:08:25 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7536228808246964888.sh 09:08:25 ---> Orphaned servers 09:08:25 Setup pyenv: 09:08:25 system 09:08:25 3.8.13 09:08:25 3.9.13 09:08:25 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 09:08:25 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A1Iv from file:/tmp/.os_lf_venv 09:08:25 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:08:30 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 09:11:11 ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device 09:11:11 09:11:12 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 09:14:58 Build timed out (after 10 minutes). Marking the build as failed. 09:14:58 $ ssh-agent -k 09:14:59 unset SSH_AUTH_SOCK; 09:14:59 unset SSH_AGENT_PID; 09:14:59 echo Agent pid 5170 killed; 09:14:59 [ssh-agent] Stopped. 09:14:59 Build was aborted 09:14:59 [PostBuildScript] - [INFO] Executing post build scripts. 09:14:59 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7456989306656316940.sh 09:14:59 ---> sysstat.sh 09:14:59 /home/jenkins/lf-env.sh: line 73: 6631 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 09:14:59 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 09:14:59 /tmp/jenkins7536228808246964888.sh: line 67: openstack: command not found 09:14:59 -----> Active servers 09:14:59 -----> Delete orphaned servers 09:15:00 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14003966349610294500.sh 09:15:00 ---> package-listing.sh 09:15:00 ++ facter osfamily 09:15:00 ++ tr '[:upper:]' '[:lower:]' 09:15:00 + OS_FAMILY=redhat 09:15:00 + workspace=/w/workspace/ci-management-openstack-cron 09:15:00 + START_PACKAGES=/tmp/packages_start.txt 09:15:00 + END_PACKAGES=/tmp/packages_end.txt 09:15:00 + DIFF_PACKAGES=/tmp/packages_diff.txt 09:15:00 + PACKAGES=/tmp/packages_start.txt 09:15:00 + '[' /w/workspace/ci-management-openstack-cron ']' 09:15:00 + PACKAGES=/tmp/packages_end.txt 09:15:00 + case "${OS_FAMILY}" in 09:15:00 + sort 09:15:00 + rpm -qa 09:15:08 + '[' -f /tmp/packages_start.txt ']' 09:15:08 + '[' -f /tmp/packages_end.txt ']' 09:15:08 + diff /tmp/packages_start.txt /tmp/packages_end.txt 09:15:08 + '[' /w/workspace/ci-management-openstack-cron ']' 09:15:08 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 09:15:08 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 09:15:08 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10288164107466629731.sh 09:15:08 ---> capture-instance-metadata.sh 09:15:08 Setup pyenv: 09:15:08 system 09:15:08 3.8.13 09:15:08 3.9.13 09:15:08 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 09:15:08 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A1Iv from file:/tmp/.os_lf_venv 09:15:08 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:15:12 lf-activate-venv(): INFO: Installing additional packages: lftools 09:15:28 lf-activate-venv(): INFO: Adding /tmp/venv-A1Iv/bin to PATH 09:15:28 INFO: Running in OpenStack, capturing instance metadata 09:15:28 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3283812754879537046.sh 09:15:28 provisioning config files... 09:15:28 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config7304637791651447921tmp 09:15:28 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 09:15:28 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 09:15:28 [EnvInject] - Injecting environment variables from a build step. 09:15:28 [EnvInject] - Injecting as environment variables the properties content 09:15:28 SERVER_ID=logs 09:15:28 09:15:28 [EnvInject] - Variables injected successfully. 09:15:28 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7051251360965458452.sh 09:15:28 ---> create-netrc.sh 09:15:28 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10537917237993829436.sh 09:15:28 ---> python-tools-install.sh 09:15:28 Setup pyenv: 09:15:29 system 09:15:29 3.8.13 09:15:29 3.9.13 09:15:29 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 09:15:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A1Iv from file:/tmp/.os_lf_venv 09:15:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:15:34 lf-activate-venv(): INFO: Installing additional packages: lftools 09:15:49 lf-activate-venv(): INFO: Adding /tmp/venv-A1Iv/bin to PATH 09:15:49 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins11742080486266249131.sh 09:15:49 ---> uv-install.sh 09:15:50 uv 0.13.7 is already installed 09:15:50 uvx 0.13.7 (x86_64-unknown-linux-gnu) 09:15:50 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9826495699894708228.sh 09:15:50 ---> sudo-logs.sh 09:15:50 Archiving 'sudo' log.. 09:15:50 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9418885724880032840.sh 09:15:50 ---> job-cost.sh 09:15:50 INFO: Activating Python virtual environment... 09:15:50 Setup pyenv: 09:15:50 system 09:15:50 3.8.13 09:15:50 3.9.13 09:15:50 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 09:15:50 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A1Iv from file:/tmp/.os_lf_venv 09:15:50 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:15:55 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 09:16:07 lf-activate-venv(): INFO: Adding /tmp/venv-A1Iv/bin to PATH 09:16:07 INFO: No stack-cost file found 09:16:07 INFO: Instance uptime: 750s 09:16:07 INFO: Fetching instance metadata (attempt 1 of 3)... 09:16:07 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 09:16:08 INFO: Successfully fetched instance metadata 09:16:08 INFO: Instance type: v3-starter-2 09:16:08 INFO: Retrieving pricing info for: v3-starter-2 09:16:08 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 09:16:08 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=750 09:16:11 INFO: Successfully fetched Vexxhost pricing API 09:16:11 INFO: Retrieved cost: 0.02 09:16:11 INFO: Retrieved resource: v3-starter-2 09:16:11 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 09:16:11 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 09:16:11 INFO: Successfully archived job cost data 09:16:11 DEBUG: Cost data: ci-management-openstack-cron,63694,2026-11-08 09:16:11,v3-starter-2,750,0.02,0.00,FAILURE 09:16:11 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins1402619303712099117.sh 09:16:11 ---> logs-deploy.sh 09:16:11 Setup pyenv: 09:16:11 system 09:16:11 3.8.13 09:16:11 3.9.13 09:16:11 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 09:16:12 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A1Iv from file:/tmp/.os_lf_venv 09:16:12 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:16:17 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 09:16:32 lf-activate-venv(): INFO: Adding /tmp/venv-A1Iv/bin to PATH 09:16:32 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63694 09:16:32 INFO: archiving workspace using pattern(s): 09:16:37 Archives upload complete. 09:16:38 INFO: archiving logs to Nexus 09:16:39 ---> uname -a: 09:16:39 Linux prd-centos8-builder-2c-4g-2224.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 09:16:39 09:16:39 09:16:39 ---> lscpu: 09:16:39 Architecture: x86_64 09:16:39 CPU op-mode(s): 32-bit, 64-bit 09:16:39 Byte Order: Little Endian 09:16:39 CPU(s): 2 09:16:39 On-line CPU(s) list: 0,1 09:16:39 Thread(s) per core: 1 09:16:39 Core(s) per socket: 1 09:16:39 Socket(s): 2 09:16:39 NUMA node(s): 1 09:16:39 Vendor ID: AuthenticAMD 09:16:39 CPU family: 23 09:16:39 Model: 49 09:16:39 Model name: AMD EPYC-Rome Processor 09:16:39 Stepping: 0 09:16:39 CPU MHz: 2799.998 09:16:39 BogoMIPS: 5599.99 09:16:39 Virtualization: AMD-V 09:16:39 Hypervisor vendor: KVM 09:16:39 Virtualization type: full 09:16:39 L1d cache: 32K 09:16:39 L1i cache: 32K 09:16:39 L2 cache: 512K 09:16:39 L3 cache: 16384K 09:16:39 NUMA node0 CPU(s): 0,1 09:16:39 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 09:16:39 09:16:39 09:16:39 ---> nproc: 09:16:39 2 09:16:39 09:16:39 09:16:39 ---> df -h: 09:16:39 Filesystem Size Used Avail Use% Mounted on 09:16:39 devtmpfs 1.8G 0 1.8G 0% /dev 09:16:39 tmpfs 1.8G 0 1.8G 0% /dev/shm 09:16:39 tmpfs 1.8G 17M 1.8G 1% /run 09:16:39 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 09:16:39 /dev/vda1 20G 15G 5.4G 74% / 09:16:39 tmpfs 367M 0 367M 0% /run/user/1001 09:16:39 09:16:39 09:16:39 ---> free -m: 09:16:39 total used free shared buff/cache available 09:16:39 Mem: 3665 465 1232 17 1967 2879 09:16:39 Swap: 1023 1 1022 09:16:39 09:16:39 09:16:39 ---> ip addr: 09:16:39 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 09:16:39 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 09:16:39 inet 127.0.0.1/8 scope host lo 09:16:39 valid_lft forever preferred_lft forever 09:16:39 inet6 ::1/128 scope host 09:16:39 valid_lft forever preferred_lft forever 09:16:39 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 09:16:39 link/ether fa:16:3e:b5:36:33 brd ff:ff:ff:ff:ff:ff 09:16:39 altname enp0s3 09:16:39 altname ens3 09:16:39 inet 10.32.6.180/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 09:16:39 valid_lft 85650sec preferred_lft 85650sec 09:16:39 inet6 fe80::f816:3eff:feb5:3633/64 scope link 09:16:39 valid_lft forever preferred_lft forever 09:16:39 09:16:39 09:16:39 ---> sar -b -r -n DEV: 09:16:39 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/08/2026 _x86_64_ (2 CPU) 09:16:39 09:16:39 09:03:45 LINUX RESTART (2 CPU) 09:16:39 09:16:39 09:05:01 AM tps rtps wtps bread/s bwrtn/s 09:16:39 09:06:01 AM 50.42 0.75 49.68 48.26 5214.16 09:16:39 09:07:01 AM 63.00 0.77 62.23 202.07 8959.00 09:16:39 09:08:01 AM 42.88 0.47 42.41 60.12 12266.46 09:16:39 09:09:02 AM 44.44 0.17 44.28 29.85 25800.70 09:16:39 09:10:01 AM 111.31 1.47 109.84 267.16 158661.51 09:16:39 09:11:01 AM 123.21 4.21 118.99 397.93 164945.91 09:16:39 09:12:01 AM 71.48 2.88 68.59 389.47 39067.51 09:16:39 09:13:01 AM 85.94 0.35 85.59 74.12 2245.38 09:16:39 09:14:01 AM 71.36 0.05 71.31 1.60 1922.48 09:16:39 09:15:01 AM 95.55 19.65 75.90 2094.18 2016.01 09:16:39 09:16:01 AM 93.29 71.76 21.53 6085.57 680.97 09:16:39 Average: 77.48 9.33 68.15 878.20 38170.33 09:16:39 09:16:39 09:05:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 09:16:39 09:06:01 AM 1382000 3031524 2371676 63.18 2104 1818396 580996 12.10 135888 1948516 137960 09:16:39 09:07:01 AM 1044944 2958276 2708732 72.16 2104 2072840 629244 13.10 138356 2246468 173864 09:16:39 09:08:01 AM 714876 2839780 3038800 80.96 2104 2280600 742700 15.47 159748 2541560 132240 09:16:39 09:09:02 AM 145888 2862208 3607788 96.11 2104 2875256 723164 15.06 188476 3089336 204828 09:16:39 09:10:01 AM 139680 2819680 3613996 96.28 2104 2833484 772000 16.08 237392 3047304 144088 09:16:39 09:11:01 AM 122396 2802640 3631280 96.74 2104 2827076 832084 17.33 288228 3048936 267676 09:16:39 09:12:01 AM 1571440 2919464 2182236 58.14 2104 1496672 712428 14.84 182956 1705440 2988 09:16:39 09:13:01 AM 1510120 2879632 2243556 59.77 2104 1517656 742712 15.47 190328 1747492 3880 09:16:39 09:14:01 AM 1444972 2828160 2308704 61.51 2104 1533536 773848 16.11 196724 1793604 3132 09:16:39 09:15:01 AM 1547960 3001516 2205716 58.76 2104 1611780 584656 12.17 211764 1659140 3564 09:16:39 09:16:01 AM 1334756 2979836 2418920 64.44 2104 1802588 596364 12.42 219692 1860776 8780 09:16:39 Average: 996276 2902065 2757400 73.46 2104 2060899 699109 14.56 195414 2244416 98455 09:16:39 09:16:39 09:05:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 09:16:39 09:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:06:01 AM eth0 51.11 42.88 890.01 4.83 0.00 0.00 0.00 0.00 09:16:39 09:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:07:01 AM eth0 66.16 58.63 1019.14 7.37 0.00 0.00 0.00 0.00 09:16:39 09:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:08:01 AM eth0 43.81 39.21 737.58 5.77 0.00 0.00 0.00 0.00 09:16:39 09:09:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:09:02 AM eth0 351.81 263.97 6640.44 20.28 0.00 0.00 0.00 0.00 09:16:39 09:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:10:01 AM eth0 1984.84 1497.82 39327.78 101.33 0.00 0.00 0.00 0.00 09:16:39 09:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:11:01 AM eth0 2194.59 1624.67 42242.05 110.52 0.00 0.00 0.00 0.00 09:16:39 09:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:12:01 AM eth0 445.58 304.05 7599.86 25.92 0.00 0.00 0.00 0.00 09:16:39 09:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:13:01 AM eth0 53.69 35.84 119.13 12.40 0.00 0.00 0.00 0.00 09:16:39 09:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:14:01 AM eth0 43.12 29.84 100.90 10.30 0.00 0.00 0.00 0.00 09:16:39 09:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:15:01 AM eth0 48.56 33.58 103.23 12.13 0.00 0.00 0.00 0.00 09:16:39 09:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 09:16:01 AM eth0 11.63 11.08 8.61 5.59 0.00 0.00 0.00 0.00 09:16:39 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:39 Average: eth0 479.19 356.68 8937.12 28.66 0.00 0.00 0.00 0.00 09:16:39 09:16:39 09:16:39 ---> sar -P ALL: 09:16:39 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/08/2026 _x86_64_ (2 CPU) 09:16:39 09:16:39 09:03:45 LINUX RESTART (2 CPU) 09:16:39 09:16:39 09:05:01 AM CPU %user %nice %system %iowait %steal %idle 09:16:39 09:06:01 AM all 23.40 0.00 3.06 0.97 0.08 72.49 09:16:39 09:06:01 AM 0 31.60 0.00 3.97 0.97 0.08 63.38 09:16:39 09:06:01 AM 1 15.20 0.00 2.15 0.97 0.08 81.60 09:16:39 09:07:01 AM all 25.00 0.00 3.27 2.45 0.08 69.20 09:16:39 09:07:01 AM 0 38.91 0.00 4.01 2.27 0.10 54.70 09:16:39 09:07:01 AM 1 11.08 0.00 2.52 2.62 0.07 83.70 09:16:39 09:08:01 AM all 29.81 0.00 3.04 1.23 0.09 65.82 09:16:39 09:08:01 AM 0 45.22 0.00 4.03 0.92 0.12 49.71 09:16:39 09:08:01 AM 1 14.39 0.00 2.05 1.54 0.07 81.96 09:16:39 09:09:02 AM all 22.90 0.00 3.61 1.37 0.08 72.04 09:16:39 09:09:02 AM 0 35.93 0.00 4.40 1.24 0.08 58.35 09:16:39 09:09:02 AM 1 9.89 0.00 2.82 1.50 0.07 85.71 09:16:39 09:10:01 AM all 23.70 0.00 11.50 2.92 0.10 61.78 09:16:39 09:10:01 AM 0 33.54 0.00 15.03 2.87 0.12 48.43 09:16:39 09:10:01 AM 1 14.01 0.00 8.02 2.96 0.09 74.92 09:16:39 09:11:01 AM all 21.44 0.00 12.55 2.75 0.12 63.14 09:16:39 09:11:01 AM 0 32.71 0.00 17.56 3.22 0.15 46.36 09:16:39 09:11:01 AM 1 10.36 0.00 7.62 2.30 0.08 79.64 09:16:39 09:12:01 AM all 31.49 0.00 3.71 0.96 0.10 63.73 09:16:39 09:12:01 AM 0 47.79 0.00 5.50 1.21 0.12 45.39 09:16:39 09:12:01 AM 1 15.23 0.00 1.92 0.72 0.08 82.04 09:16:39 09:13:01 AM all 38.56 0.00 1.65 0.56 0.11 59.12 09:16:39 09:13:01 AM 0 58.07 0.00 2.15 0.93 0.13 38.72 09:16:39 09:13:01 AM 1 18.98 0.00 1.16 0.18 0.08 79.60 09:16:39 09:14:01 AM all 40.79 0.00 1.27 0.32 0.13 57.50 09:16:39 09:14:01 AM 0 63.59 0.00 1.68 0.53 0.15 34.05 09:16:39 09:14:01 AM 1 17.90 0.00 0.85 0.10 0.10 81.04 09:16:39 09:15:01 AM all 39.98 0.00 1.58 1.31 0.11 57.02 09:16:39 09:15:01 AM 0 68.33 0.00 2.32 2.27 0.15 26.93 09:16:39 09:15:01 AM 1 11.49 0.00 0.84 0.35 0.07 87.25 09:16:39 09:16:01 AM all 23.45 0.00 2.52 5.82 0.08 68.15 09:16:39 09:16:01 AM 0 29.08 0.00 2.79 10.41 0.08 57.64 09:16:39 09:16:01 AM 1 17.81 0.00 2.24 1.22 0.07 78.67 09:16:39 09:16:39 Average: CPU %user %nice %system %iowait %steal %idle 09:16:39 Average: all 29.16 0.00 4.32 1.87 0.10 64.56 09:16:39 Average: 0 44.13 0.00 5.72 2.44 0.12 47.60 09:16:39 Average: 1 14.21 0.00 2.92 1.31 0.08 81.48 09:16:39 09:16:39 09:16:39