20:06:16 Started by timer 20:06:16 Running as SYSTEM 20:06:16 [EnvInject] - Loading node environment variables. 20:06:16 Building remotely on prd-centos8-builder-2c-4g-12147 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 20:06:16 [ssh-agent] Looking for ssh-agent implementation... 20:06:16 $ ssh-agent 20:06:16 SSH_AUTH_SOCK=/tmp/ssh-Fyz6hzxRwYZW/agent.5189 20:06:16 SSH_AGENT_PID=5191 20:06:16 [ssh-agent] Started. 20:06:16 Running ssh-add (command line suppressed) 20:06:17 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_11575368070496508981.key (jenkins-ssh) 20:06:17 [ssh-agent] Using credentials jenkins (jenkins) 20:06:17 The recommended git tool is: NONE 20:06:18 using credential jenkins 20:06:18 Wiping out workspace first. 20:06:18 Cloning the remote Git repository 20:06:18 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 20:06:19 > git init /w/workspace/ci-management-openstack-cron # timeout=10 20:06:19 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 20:06:19 > git --version # timeout=10 20:06:19 > git --version # 'git version 2.43.0' 20:06:19 using GIT_SSH to set credentials jenkins 20:06:19 [INFO] Currently running in a labeled security context 20:06:19 [INFO] Currently SELinux is 'enforcing' on the host 20:06:19 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh3903671784285884568.key 20:06:19 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 20:06:22 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 20:06:22 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 20:06:23 Avoid second fetch 20:06:23 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 20:06:23 Checking out Revision fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c (refs/remotes/origin/master) 20:06:23 > git config core.sparsecheckout # timeout=10 20:06:23 > git checkout -f fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10 20:06:23 Commit message: "Chore: Update global-jjb to v0.95.0" 20:06:23 > git rev-list --no-walk fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10 20:06:23 > git remote # timeout=10 20:06:23 > git submodule init # timeout=10 20:06:23 > git submodule sync # timeout=10 20:06:24 > git config --get remote.origin.url # timeout=10 20:06:24 > git submodule init # timeout=10 20:06:24 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 20:06:24 > git config --get submodule.packer/common-packer.url # timeout=10 20:06:24 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 20:06:24 > git config --get submodule.global-jjb.url # timeout=10 20:06:24 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 20:06:24 > git submodule update --init --recursive packer/common-packer # timeout=10 20:06:28 > git submodule update --init --recursive global-jjb # timeout=10 20:06:39 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:06:39 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:06:39 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:06:39 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:06:39 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:06:39 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:06:39 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 20:06:39 provisioning config files... 20:06:39 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 20:06:39 copy managed file [npmrc] to file:/home/jenkins/.npmrc 20:06:39 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 20:06:39 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16618307510246236268.sh 20:06:39 ---> python-tools-install.sh 20:06:39 Setup pyenv: 20:06:39 system 20:06:39 * 3.8.13 (set by /opt/pyenv/version) 20:06:39 * 3.9.13 (set by /opt/pyenv/version) 20:06:39 * 3.10.6 (set by /opt/pyenv/version) 20:06:44 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-7A5p 20:06:44 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 20:06:44 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:06:52 lf-activate-venv(): INFO: Installing additional packages: lftools 20:07:30 lf-activate-venv(): INFO: Adding /tmp/venv-7A5p/bin to PATH 20:07:30 Generating Requirements File 20:08:11 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 20:08:11 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 20:08:12 Python 3.10.6 20:08:12 pip 26.2.1 from /tmp/venv-7A5p/lib/python3.10/site-packages/pip (python 3.10) 20:08:12 aiohappyeyeballs==2.7.1 20:08:12 aiohttp==3.14.3 20:08:12 aiosignal==1.4.0 20:08:12 appdirs==1.4.4 20:08:12 argcomplete==3.7.2 20:08:12 aspy.yaml==1.3.0 20:08:12 async-timeout==5.0.1 20:08:12 attrs==26.1.0 20:08:12 autopage==0.6.0 20:08:12 backports.strenum==1.3.1 20:08:12 beautifulsoup4==4.15.0 20:08:12 boto3==1.43.93 20:08:12 botocore==1.43.93 20:08:12 bs4==0.0.2 20:08:12 certifi==2026.7.22 20:08:12 cffi==2.1.1 20:08:12 cfgv==3.5.0 20:08:12 chardet==7.6.0 20:08:12 charset-normalizer==3.5.1 20:08:12 click==8.5.0 20:08:12 cliff==4.14.0 20:08:12 cmd2==3.5.1 20:08:12 cryptography==3.3.2 20:08:12 debtcollector==3.1.0 20:08:12 decorator==5.3.1 20:08:12 defusedxml==0.7.1 20:08:12 Deprecated==1.3.1 20:08:12 distlib==0.4.3 20:08:12 dnspython==2.8.0 20:08:12 docker==7.2.0 20:08:12 dogpile.cache==1.5.0 20:08:12 durationpy==0.11 20:08:12 email-validator==2.3.0 20:08:12 filelock==3.32.6 20:08:12 frozenlist==1.8.0 20:08:12 future==1.0.0 20:08:12 gitdb==4.0.12 20:08:12 GitPython==3.1.62 20:08:12 httplib2==0.30.2 20:08:12 identify==2.6.19 20:08:12 idna==3.19 20:08:12 importlib-resources==1.5.0 20:08:12 iso8601==2.1.0 20:08:12 Jinja2==3.1.6 20:08:12 jmespath==1.1.0 20:08:12 jsonpatch==1.33 20:08:12 jsonpointer==3.1.1 20:08:12 jsonschema==4.26.0 20:08:12 jsonschema-specifications==2025.9.1 20:08:12 keystoneauth1==5.14.0 20:08:12 kubernetes==36.0.3 20:08:12 lftools==0.37.23 20:08:12 lxml==6.1.3 20:08:12 markdown-it-py==4.2.0 20:08:12 MarkupSafe==3.0.3 20:08:12 mdurl==0.1.2 20:08:12 msgpack==1.2.2 20:08:12 multi_key_dict==2.0.3 20:08:12 multidict==6.8.0 20:08:12 munch==4.0.0 20:08:12 netaddr==1.3.0 20:08:12 niet==1.4.2 20:08:12 nodeenv==1.10.0 20:08:12 oauth2client==4.1.3 20:08:12 oauthlib==3.3.1 20:08:12 openstacksdk==4.13.0 20:08:12 os-service-types==1.8.2 20:08:12 osc-lib==4.6.0 20:08:12 oslo.config==10.4.0 20:08:12 oslo.context==6.4.0 20:08:12 oslo.i18n==6.8.0 20:08:12 oslo.log==8.2.0 20:08:12 oslo.serialization==5.10.0 20:08:12 oslo.utils==10.1.1 20:08:12 packaging==26.3 20:08:12 pbr==7.0.3 20:08:12 platformdirs==4.11.8 20:08:12 prettytable==3.18.0 20:08:12 propcache==0.5.2 20:08:12 psutil==7.2.2 20:08:12 pyasn1==0.6.4 20:08:12 pyasn1_modules==0.4.2 20:08:12 pycparser==3.0 20:08:12 pygerrit2==2.0.15 20:08:12 PyGithub==2.10.0 20:08:12 Pygments==2.21.0 20:08:12 PyJWT==2.14.0 20:08:12 PyNaCl==1.6.2 20:08:12 pyparsing==2.4.7 20:08:12 pyperclip==1.11.0 20:08:12 pyrsistent==0.20.0 20:08:12 python-cinderclient==9.9.0 20:08:12 python-dateutil==2.9.0.post0 20:08:12 python-discovery==1.6.0 20:08:12 python-heatclient==5.2.0 20:08:12 python-jenkins==1.8.3 20:08:12 python-keystoneclient==6.0.0 20:08:12 python-magnumclient==4.11.0 20:08:12 python-openstackclient==10.0.0 20:08:12 python-swiftclient==4.11.0 20:08:12 PyYAML==6.0.3 20:08:12 referencing==0.37.0 20:08:12 requests==2.34.2 20:08:12 requests-oauthlib==2.0.0 20:08:12 rfc3986==2.0.0 20:08:12 rich==15.0.0 20:08:12 rich-argparse==1.8.0 20:08:12 rpds-py==0.30.0 20:08:12 rsa==4.9.1 20:08:12 ruamel.yaml==0.19.1 20:08:12 ruamel.yaml.clib==0.2.15 20:08:12 s3transfer==0.19.2 20:08:12 simplejson==4.1.2 20:08:12 six==1.17.0 20:08:12 smmap==5.0.3 20:08:12 soupsieve==2.9.2 20:08:12 stevedore==5.8.0 20:08:12 tabulate==0.10.0 20:08:12 toml==0.10.2 20:08:12 tomlkit==0.15.1 20:08:12 tqdm==4.70.1 20:08:12 typing_extensions==4.16.0 20:08:12 urllib3==1.26.20 20:08:12 virtualenv==21.7.9 20:08:12 wcwidth==0.8.3 20:08:12 websocket-client==1.9.2 20:08:12 wrapt==2.4.1 20:08:12 xdg==6.0.0 20:08:12 xmltodict==1.0.4 20:08:12 yarl==1.24.5 20:08:12 yq==4.1.2 20:08:12 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins16199717182529279937.sh 20:08:12 ---> uv-install.sh 20:08:12 Installing uv/uvx (latest) using shell installer 20:08:19 2026-09-12 20:08:19 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71308/71308] -> "/tmp/uv-install-w7YCdq.sh" [1] 20:08:19 downloading uv 0.12.13 x86_64-unknown-linux-gnu 20:08:24 installing to /home/jenkins/.local/bin 20:08:24 uv 20:08:24 uvx 20:08:24 everything's installed! 20:08:24 ---> Validating uv/uvx install 20:08:24 uvx 0.12.13 (x86_64-unknown-linux-gnu) 20:08:24 [EnvInject] - Injecting environment variables from a build step. 20:08:24 [EnvInject] - Injecting as environment variables the properties content 20:08:24 OS_CLOUD=vex 20:08:24 20:08:24 [EnvInject] - Variables injected successfully. 20:08:24 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 20:08:24 Run condition [Boolean condition] enabling perform for step [Execute shell] 20:08:24 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins9764415986251580481.sh 20:08:24 ---> Orphaned k8s clusters 20:08:24 Setup pyenv: 20:08:24 system 20:08:24 3.8.13 20:08:24 3.9.13 20:08:24 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:08:24 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7A5p from file:/tmp/.os_lf_venv 20:08:24 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:08:29 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 20:08:44 lf-activate-venv(): INFO: Adding /tmp/venv-7A5p/bin to PATH 20:09:54 -----> Delete orphaned cluster 20:09:54 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 20:09:54 Run condition [Boolean condition] enabling perform for step [Execute shell] 20:09:54 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins9091492949635010430.sh 20:09:54 ---> Orphaned stacks 20:09:54 Setup pyenv: 20:09:54 system 20:09:54 3.8.13 20:09:54 3.9.13 20:09:54 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:09:54 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7A5p from file:/tmp/.os_lf_venv 20:09:54 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:09:59 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 20:10:24 lf-activate-venv(): INFO: Adding /tmp/venv-7A5p/bin to PATH 20:10:24 + mapfile -t OS_COE_CLUSTERS_ID 20:10:24 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 20:10:24 ++ awk '{print $1}' 20:10:24 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 20:13:32 Gateway Timeout (HTTP 504) 20:13:32 + echo '-----> Active clusters -> stacks' 20:13:32 -----> Active clusters -> stacks 20:13:32 + OS_COE_STACKS=() 20:13:32 + [[ 0 -gt 0 ]] 20:13:32 + mapfile -t OS_STACKS 20:13:32 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 20:13:32 ++ awk '{print $1}' 20:13:41 + echo '-----> Active stacks' 20:13:41 -----> Active stacks 20:13:41 + echo '-----> Delete orphaned stacks' 20:13:41 -----> Delete orphaned stacks 20:13:41 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 20:13:41 Run condition [Boolean condition] enabling perform for step [Execute shell] 20:13:41 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins17769975222700207894.sh 20:13:41 ---> Orphaned servers 20:13:41 Setup pyenv: 20:13:41 system 20:13:41 3.8.13 20:13:41 3.9.13 20:13:41 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:13:41 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7A5p from file:/tmp/.os_lf_venv 20:13:41 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:13:46 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 20:14:09 lf-activate-venv(): INFO: Adding /tmp/venv-7A5p/bin to PATH 20:15:23 -----> Active servers 20:15:23 prd-ubuntu1804-docker-4c-4g-12151 20:15:23 prd-ubuntu1804-docker-4c-4g-12145 20:15:23 prd-ubuntu1804-docker-4c-4g-12150 20:15:23 prd-ubuntu1804-docker-4c-4g-12149 20:15:23 prd-centos8-builder-2c-4g-12147 20:15:23 -----> Delete orphaned servers 20:15:30 Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-12151 20:16:39 Build timed out (after 10 minutes). Marking the build as failed. 20:16:39 $ ssh-agent -k 20:16:39 unset SSH_AUTH_SOCK; 20:16:39 unset SSH_AGENT_PID; 20:16:39 echo Agent pid 5191 killed; 20:16:39 [ssh-agent] Stopped. 20:16:39 Build was aborted 20:16:39 [PostBuildScript] - [INFO] Executing post build scripts. 20:16:39 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins66056761007685025.sh 20:16:39 ---> sysstat.sh 20:16:39 /tmp/jenkins17769975222700207894.sh: line 81: 6690 Terminated lftools openstack --os-cloud "$os_cloud" server remove --minutes 15 "$server" 20:16:39 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2549364589728549716.sh 20:16:39 ---> package-listing.sh 20:16:39 ++ facter osfamily 20:16:39 ++ tr '[:upper:]' '[:lower:]' 20:16:39 + OS_FAMILY=redhat 20:16:39 + workspace=/w/workspace/ci-management-openstack-cron 20:16:39 + START_PACKAGES=/tmp/packages_start.txt 20:16:39 + END_PACKAGES=/tmp/packages_end.txt 20:16:39 + DIFF_PACKAGES=/tmp/packages_diff.txt 20:16:39 + PACKAGES=/tmp/packages_start.txt 20:16:39 + '[' /w/workspace/ci-management-openstack-cron ']' 20:16:39 + PACKAGES=/tmp/packages_end.txt 20:16:39 + case "${OS_FAMILY}" in 20:16:39 + rpm -qa 20:16:39 + sort 20:16:40 + '[' -f /tmp/packages_start.txt ']' 20:16:40 + '[' -f /tmp/packages_end.txt ']' 20:16:40 + diff /tmp/packages_start.txt /tmp/packages_end.txt 20:16:40 + '[' /w/workspace/ci-management-openstack-cron ']' 20:16:40 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 20:16:40 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 20:16:40 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10055825587413784930.sh 20:16:40 ---> capture-instance-metadata.sh 20:16:40 Setup pyenv: 20:16:40 system 20:16:40 3.8.13 20:16:40 3.9.13 20:16:40 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:16:40 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7A5p from file:/tmp/.os_lf_venv 20:16:40 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:16:42 (23) Failed writing body 20:16:43 lf-activate-venv(): INFO: Installing additional packages: lftools 20:16:58 lf-activate-venv(): INFO: Adding /tmp/venv-7A5p/bin to PATH 20:16:58 INFO: Running in OpenStack, capturing instance metadata 20:16:58 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10986967142076888109.sh 20:16:58 provisioning config files... 20:16:58 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config2648582473734004671tmp 20:16:58 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 20:16:58 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 20:16:58 [EnvInject] - Injecting environment variables from a build step. 20:16:58 [EnvInject] - Injecting as environment variables the properties content 20:16:58 SERVER_ID=logs 20:16:58 20:16:58 [EnvInject] - Variables injected successfully. 20:16:58 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1675646004834905974.sh 20:16:58 ---> create-netrc.sh 20:16:58 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6447426112937763087.sh 20:16:58 ---> python-tools-install.sh 20:16:58 Setup pyenv: 20:16:58 system 20:16:59 3.8.13 20:16:59 3.9.13 20:16:59 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:16:59 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7A5p from file:/tmp/.os_lf_venv 20:16:59 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:17:04 lf-activate-venv(): INFO: Installing additional packages: lftools 20:17:19 lf-activate-venv(): INFO: Adding /tmp/venv-7A5p/bin to PATH 20:17:19 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins17380893122400901155.sh 20:17:19 ---> uv-install.sh 20:17:19 uv 0.12.13 is already installed 20:17:19 uvx 0.12.13 (x86_64-unknown-linux-gnu) 20:17:19 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins15433279318142716776.sh 20:17:19 ---> sudo-logs.sh 20:17:19 Archiving 'sudo' log.. 20:17:19 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4389287052896450918.sh 20:17:19 ---> job-cost.sh 20:17:19 INFO: Activating Python virtual environment... 20:17:19 Setup pyenv: 20:17:19 system 20:17:19 3.8.13 20:17:19 3.9.13 20:17:19 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:17:19 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7A5p from file:/tmp/.os_lf_venv 20:17:19 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:17:24 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 20:17:36 lf-activate-venv(): INFO: Adding /tmp/venv-7A5p/bin to PATH 20:17:36 INFO: No stack-cost file found 20:17:36 INFO: Instance uptime: 738s 20:17:36 INFO: Fetching instance metadata (attempt 1 of 3)... 20:17:36 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 20:17:36 INFO: Successfully fetched instance metadata 20:17:36 INFO: Instance type: v3-starter-2 20:17:36 INFO: Retrieving pricing info for: v3-starter-2 20:17:36 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 20:17:36 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=738 20:17:39 INFO: Successfully fetched Vexxhost pricing API 20:17:39 INFO: Retrieved cost: 0.02 20:17:39 INFO: Retrieved resource: v3-starter-2 20:17:39 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 20:17:39 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 20:17:39 INFO: Successfully archived job cost data 20:17:39 DEBUG: Cost data: ci-management-openstack-cron,62337,2026-09-12 20:17:39,v3-starter-2,738,0.02,0.00,FAILURE 20:17:39 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8995220473334751530.sh 20:17:40 ---> logs-deploy.sh 20:17:40 Setup pyenv: 20:17:40 system 20:17:40 3.8.13 20:17:40 3.9.13 20:17:40 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:17:40 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7A5p from file:/tmp/.os_lf_venv 20:17:40 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:17:45 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 20:17:59 lf-activate-venv(): INFO: Adding /tmp/venv-7A5p/bin to PATH 20:17:59 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/62337 20:17:59 INFO: archiving workspace using pattern(s): 20:18:04 Archives upload complete. 20:18:04 INFO: archiving logs to Nexus 20:18:05 ---> uname -a: 20:18:05 Linux prd-centos8-builder-2c-4g-12147.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 20:18:05 20:18:05 20:18:05 ---> lscpu: 20:18:05 Architecture: x86_64 20:18:05 CPU op-mode(s): 32-bit, 64-bit 20:18:05 Byte Order: Little Endian 20:18:05 CPU(s): 2 20:18:05 On-line CPU(s) list: 0,1 20:18:05 Thread(s) per core: 1 20:18:05 Core(s) per socket: 1 20:18:05 Socket(s): 2 20:18:05 NUMA node(s): 1 20:18:05 Vendor ID: AuthenticAMD 20:18:05 CPU family: 23 20:18:05 Model: 49 20:18:05 Model name: AMD EPYC-Rome Processor 20:18:05 Stepping: 0 20:18:05 CPU MHz: 2800.000 20:18:05 BogoMIPS: 5600.00 20:18:05 Virtualization: AMD-V 20:18:05 Hypervisor vendor: KVM 20:18:05 Virtualization type: full 20:18:05 L1d cache: 32K 20:18:05 L1i cache: 32K 20:18:05 L2 cache: 512K 20:18:05 L3 cache: 16384K 20:18:05 NUMA node0 CPU(s): 0,1 20:18:05 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 20:18:05 20:18:05 20:18:05 ---> nproc: 20:18:05 2 20:18:05 20:18:05 20:18:05 ---> df -h: 20:18:05 Filesystem Size Used Avail Use% Mounted on 20:18:05 devtmpfs 1.8G 0 1.8G 0% /dev 20:18:05 tmpfs 1.8G 0 1.8G 0% /dev/shm 20:18:05 tmpfs 1.8G 17M 1.8G 1% /run 20:18:05 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 20:18:05 /dev/vda1 20G 9.2G 11G 46% / 20:18:05 tmpfs 367M 0 367M 0% /run/user/1001 20:18:05 20:18:05 20:18:05 ---> free -m: 20:18:05 total used free shared buff/cache available 20:18:05 Mem: 3665 495 1000 17 2169 2893 20:18:05 Swap: 1023 0 1023 20:18:05 20:18:05 20:18:05 ---> ip addr: 20:18:05 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 20:18:05 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 20:18:05 inet 127.0.0.1/8 scope host lo 20:18:05 valid_lft forever preferred_lft forever 20:18:05 inet6 ::1/128 scope host 20:18:05 valid_lft forever preferred_lft forever 20:18:05 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 20:18:05 link/ether fa:16:3e:7b:b9:53 brd ff:ff:ff:ff:ff:ff 20:18:05 altname enp0s3 20:18:05 altname ens3 20:18:05 inet 10.32.7.48/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 20:18:05 valid_lft 85665sec preferred_lft 85665sec 20:18:05 inet6 fe80::f816:3eff:fe7b:b953/64 scope link 20:18:05 valid_lft forever preferred_lft forever 20:18:05 20:18:05 20:18:05 ---> sar -b -r -n DEV: 20:18:05 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 09/12/2026 _x86_64_ (2 CPU) 20:18:05 20:18:05 20:05:26 LINUX RESTART (2 CPU) 20:18:05 20:18:05 08:06:01 PM tps rtps wtps bread/s bwrtn/s 20:18:05 08:07:01 PM 154.42 75.07 79.34 8963.68 39102.92 20:18:05 08:08:01 PM 65.21 0.20 65.01 30.00 7623.08 20:18:05 08:09:01 PM 45.48 1.25 44.24 234.86 9260.70 20:18:05 08:10:01 PM 7.26 0.00 7.26 0.00 914.05 20:18:05 08:11:01 PM 20.76 0.05 20.71 1.33 2303.52 20:18:05 08:12:01 PM 2.47 0.00 2.47 0.00 90.30 20:18:05 08:13:01 PM 0.43 0.00 0.43 0.00 5.67 20:18:05 08:14:01 PM 7.85 0.00 7.85 0.00 195.32 20:18:05 08:15:01 PM 10.25 0.00 10.25 0.00 401.22 20:18:05 08:16:01 PM 1.37 0.80 0.57 51.86 13.85 20:18:05 08:17:01 PM 7.45 0.25 7.20 25.06 216.43 20:18:05 08:18:02 PM 17.71 0.20 17.51 23.33 506.41 20:18:05 Average: 28.39 6.49 21.90 777.54 5052.89 20:18:05 20:18:05 08:06:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 20:18:05 08:07:01 PM 1530456 3014068 2223228 59.23 2104 1662460 639656 13.32 140912 1833492 42068 20:18:05 08:08:01 PM 1249832 2972100 2503852 66.70 2104 1889448 644864 13.43 144260 2064620 87200 20:18:05 08:09:01 PM 1082108 2973308 2671576 71.17 2104 2050640 618208 12.87 146148 2198260 23188 20:18:05 08:10:01 PM 1113200 3006000 2640484 70.34 2104 2052172 584940 12.18 147700 2166296 7364 20:18:05 08:11:01 PM 1049792 2980428 2703892 72.03 2104 2089724 611848 12.74 158952 2216612 4 20:18:05 08:12:01 PM 1049692 2980328 2703992 72.04 2104 2089724 611848 12.74 158952 2216784 4 20:18:05 08:13:01 PM 1049224 2979844 2704460 72.05 2104 2089724 611848 12.74 158952 2216796 4 20:18:05 08:14:01 PM 967452 2930680 2786232 74.23 2104 2122336 660152 13.75 176196 2283352 38436 20:18:05 08:15:01 PM 1051056 2981892 2702628 72.00 2104 2089712 609468 12.69 173976 2201604 4 20:18:05 08:16:01 PM 1027032 2959244 2726652 72.64 2104 2091252 634912 13.22 176328 2222240 4 20:18:05 08:17:01 PM 1073340 3006760 2680344 71.41 2104 2092176 587500 12.23 360400 1993624 6004 20:18:05 08:18:02 PM 1026444 2964244 2727240 72.66 2104 2095976 635252 13.23 376904 2022040 19356 20:18:05 Average: 1105802 2979075 2647882 70.54 2104 2034612 620875 12.93 193307 2136310 18636 20:18:05 20:18:05 08:06:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 20:18:05 08:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:07:01 PM eth0 249.75 124.09 1067.85 56.57 0.00 0.00 0.00 0.00 20:18:05 08:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:08:01 PM eth0 48.93 43.28 890.10 5.78 0.00 0.00 0.00 0.00 20:18:05 08:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:09:01 PM eth0 38.42 33.34 330.76 4.46 0.00 0.00 0.00 0.00 20:18:05 08:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:10:01 PM eth0 1.45 1.28 0.94 0.47 0.00 0.00 0.00 0.00 20:18:05 08:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:11:01 PM eth0 33.79 30.47 648.69 4.17 0.00 0.00 0.00 0.00 20:18:05 08:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:12:01 PM eth0 0.62 0.33 0.59 0.08 0.00 0.00 0.00 0.00 20:18:05 08:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:13:01 PM eth0 0.15 0.13 0.01 0.01 0.00 0.00 0.00 0.00 20:18:05 08:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:14:01 PM eth0 5.03 5.00 2.75 2.23 0.00 0.00 0.00 0.00 20:18:05 08:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:15:01 PM eth0 2.08 2.47 1.27 0.90 0.00 0.00 0.00 0.00 20:18:05 08:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:16:01 PM eth0 2.97 2.97 5.85 0.36 0.00 0.00 0.00 0.00 20:18:05 08:17:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:17:01 PM eth0 10.05 8.56 7.65 7.87 0.00 0.00 0.00 0.00 20:18:05 08:18:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 08:18:02 PM eth0 9.96 11.41 5.99 5.06 0.00 0.00 0.00 0.00 20:18:05 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:18:05 Average: eth0 33.60 21.94 246.87 7.33 0.00 0.00 0.00 0.00 20:18:05 20:18:05 20:18:05 ---> sar -P ALL: 20:18:05 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 09/12/2026 _x86_64_ (2 CPU) 20:18:05 20:18:05 20:05:26 LINUX RESTART (2 CPU) 20:18:05 20:18:05 08:06:01 PM CPU %user %nice %system %iowait %steal %idle 20:18:05 08:07:01 PM all 26.18 0.00 6.35 7.79 0.08 59.59 20:18:05 08:07:01 PM 0 24.85 0.00 6.44 6.79 0.07 61.84 20:18:05 08:07:01 PM 1 27.51 0.00 6.26 8.79 0.10 57.34 20:18:05 08:08:01 PM all 25.70 0.00 3.24 2.28 0.09 68.70 20:18:05 08:08:01 PM 0 18.52 0.00 3.02 2.99 0.08 75.38 20:18:05 08:08:01 PM 1 32.86 0.00 3.45 1.57 0.10 62.03 20:18:05 08:09:01 PM all 18.69 0.00 2.85 1.31 0.07 77.09 20:18:05 08:09:01 PM 0 22.50 0.00 3.03 1.32 0.08 73.07 20:18:05 08:09:01 PM 1 14.90 0.00 2.67 1.30 0.05 81.09 20:18:05 08:10:01 PM all 2.20 0.00 0.57 0.22 0.04 96.97 20:18:05 08:10:01 PM 0 0.75 0.00 0.43 0.12 0.05 98.65 20:18:05 08:10:01 PM 1 3.65 0.00 0.70 0.32 0.03 95.30 20:18:05 08:11:01 PM all 14.98 0.00 1.02 0.58 0.05 83.37 20:18:05 08:11:01 PM 0 12.70 0.00 1.27 0.23 0.05 85.74 20:18:05 08:11:01 PM 1 17.25 0.00 0.77 0.93 0.05 81.00 20:18:05 08:12:01 PM all 0.33 0.00 0.06 0.08 0.02 99.51 20:18:05 08:12:01 PM 0 0.10 0.00 0.10 0.17 0.03 99.60 20:18:05 08:12:01 PM 1 0.57 0.00 0.02 0.00 0.00 99.42 20:18:05 08:13:01 PM all 0.32 0.00 0.10 0.00 0.03 99.56 20:18:05 08:13:01 PM 0 0.12 0.00 0.15 0.00 0.03 99.70 20:18:05 08:13:01 PM 1 0.52 0.00 0.05 0.00 0.02 99.42 20:18:05 08:14:01 PM all 10.77 0.00 0.82 0.17 0.05 88.20 20:18:05 08:14:01 PM 0 12.70 0.00 0.84 0.18 0.07 86.22 20:18:05 08:14:01 PM 1 8.84 0.00 0.80 0.15 0.03 90.18 20:18:05 08:15:01 PM all 6.30 0.00 0.41 0.27 0.04 92.98 20:18:05 08:15:01 PM 0 2.19 0.00 0.32 0.27 0.03 97.19 20:18:05 08:15:01 PM 1 10.41 0.00 0.50 0.27 0.05 88.77 20:18:05 08:16:01 PM all 1.67 0.00 0.23 0.03 0.03 98.04 20:18:05 08:16:01 PM 0 2.02 0.00 0.32 0.07 0.02 97.58 20:18:05 08:16:01 PM 1 1.32 0.00 0.15 0.00 0.03 98.50 20:18:05 08:17:01 PM all 11.20 0.00 1.39 0.06 0.05 87.29 20:18:05 08:17:01 PM 0 2.76 0.00 1.20 0.03 0.05 95.96 20:18:05 08:17:01 PM 1 19.64 0.00 1.58 0.08 0.05 78.65 20:18:05 20:18:05 08:17:01 PM CPU %user %nice %system %iowait %steal %idle 20:18:05 08:18:02 PM all 26.80 0.00 2.43 0.18 0.08 70.51 20:18:05 08:18:02 PM 0 11.79 0.00 1.89 0.27 0.07 85.99 20:18:05 08:18:02 PM 1 41.78 0.00 2.97 0.10 0.08 55.07 20:18:05 Average: all 12.09 0.00 1.62 1.08 0.05 85.16 20:18:05 Average: 0 9.25 0.00 1.58 1.04 0.05 88.08 20:18:05 Average: 1 14.93 0.00 1.66 1.12 0.05 82.24 20:18:05 20:18:05 20:18:05