00:04:36 Started by timer 00:04:36 Running as SYSTEM 00:04:36 [EnvInject] - Loading node environment variables. 00:04:36 Building remotely on prd-centos8-builder-2c-4g-2495 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 00:04:36 [ssh-agent] Looking for ssh-agent implementation... 00:04:36 $ ssh-agent 00:04:36 SSH_AUTH_SOCK=/tmp/ssh-6cb8w7Jpo25N/agent.5176 00:04:36 SSH_AGENT_PID=5178 00:04:36 [ssh-agent] Started. 00:04:36 Running ssh-add (command line suppressed) 00:04:36 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_13264572461161673164.key (jenkins-ssh) 00:04:37 [ssh-agent] Using credentials jenkins (jenkins) 00:04:37 The recommended git tool is: NONE 00:04:39 using credential jenkins 00:04:39 Wiping out workspace first. 00:04:39 Cloning the remote Git repository 00:04:39 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 00:04:39 > git init /w/workspace/ci-management-openstack-cron # timeout=10 00:04:39 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 00:04:39 > git --version # timeout=10 00:04:39 > git --version # 'git version 2.43.0' 00:04:39 using GIT_SSH to set credentials jenkins 00:04:39 [INFO] Currently running in a labeled security context 00:04:39 [INFO] Currently SELinux is 'enforcing' on the host 00:04:39 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh10596709636499918020.key 00:04:39 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 00:04:43 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 00:04:43 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 00:04:43 Avoid second fetch 00:04:43 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 00:04:43 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 00:04:43 > git config core.sparsecheckout # timeout=10 00:04:43 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 00:04:43 Commit message: "CI: Update github2gerrit caller to v2.4.4" 00:04:43 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 00:04:44 > git remote # timeout=10 00:04:44 > git submodule init # timeout=10 00:04:44 > git submodule sync # timeout=10 00:04:44 > git config --get remote.origin.url # timeout=10 00:04:44 > git submodule init # timeout=10 00:04:44 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 00:04:44 > git config --get submodule.packer/common-packer.url # timeout=10 00:04:44 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 00:04:44 > git config --get submodule.global-jjb.url # timeout=10 00:04:44 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 00:04:44 > git submodule update --init --recursive packer/common-packer # timeout=10 00:04:49 > git submodule update --init --recursive global-jjb # timeout=10 00:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:01 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 00:05:01 provisioning config files... 00:05:01 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 00:05:01 copy managed file [npmrc] to file:/home/jenkins/.npmrc 00:05:01 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 00:05:01 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins8994096261316027779.sh 00:05:01 ---> python-tools-install.sh 00:05:01 Setup pyenv: 00:05:01 system 00:05:01 * 3.8.13 (set by /opt/pyenv/version) 00:05:01 * 3.9.13 (set by /opt/pyenv/version) 00:05:01 * 3.10.6 (set by /opt/pyenv/version) 00:05:06 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-rfoT 00:05:06 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 00:05:06 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:05:17 lf-activate-venv(): INFO: Installing additional packages: lftools 00:05:52 lf-activate-venv(): INFO: Adding /tmp/venv-rfoT/bin to PATH 00:05:52 Generating Requirements File 00:06:35 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 00:06:35 botocore 1.44.0 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 00:06:35 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 00:06:36 Python 3.10.6 00:06:36 pip 26.3 from /tmp/venv-rfoT/lib/python3.10/site-packages/pip (python 3.10) 00:06:36 aiohappyeyeballs==2.7.1 00:06:36 aiohttp==3.14.5 00:06:36 aiosignal==1.4.0 00:06:36 appdirs==1.4.4 00:06:36 argcomplete==3.7.2 00:06:36 aspy.yaml==1.3.0 00:06:36 async-timeout==5.0.1 00:06:36 attrs==26.1.0 00:06:36 autopage==0.6.0 00:06:36 backports.strenum==1.3.1 00:06:36 beautifulsoup4==4.15.0 00:06:36 boto3==1.44.0 00:06:36 botocore==1.44.0 00:06:36 bs4==0.0.2 00:06:36 certifi==2026.10.23 00:06:36 cffi==2.1.1 00:06:36 cfgv==3.5.0 00:06:36 chardet==7.7.0 00:06:36 charset-normalizer==3.5.2 00:06:36 click==8.5.1 00:06:36 cliff==4.14.0 00:06:36 cmd2==3.5.1 00:06:36 cryptography==3.3.2 00:06:36 debtcollector==3.1.0 00:06:36 decorator==5.3.1 00:06:36 defusedxml==0.7.1 00:06:36 Deprecated==1.3.1 00:06:36 distlib==0.4.4 00:06:36 dnspython==2.8.0 00:06:36 docker==7.2.0 00:06:36 dogpile.cache==1.5.0 00:06:36 durationpy==0.11 00:06:36 email-validator==2.3.0 00:06:36 filelock==4.1.0 00:06:36 frozenlist==1.8.0 00:06:36 future==1.0.0 00:06:36 gitdb==4.0.12 00:06:36 GitPython==3.2.1 00:06:36 httplib2==0.30.2 00:06:36 identify==2.6.20 00:06:36 idna==3.20 00:06:36 importlib-resources==1.5.0 00:06:36 iso8601==2.1.0 00:06:36 Jinja2==3.1.6 00:06:36 jmespath==1.1.0 00:06:36 jsonpatch==1.46 00:06:36 jsonpointer==3.12 00:06:36 jsonschema==4.26.0 00:06:36 jsonschema-specifications==2025.9.1 00:06:36 keystoneauth1==5.14.0 00:06:36 kubernetes==36.0.3 00:06:36 lftools==0.37.26 00:06:36 lxml==6.1.3 00:06:36 markdown-it-py==4.3.0 00:06:36 MarkupSafe==3.0.4 00:06:36 mdurl==0.1.2 00:06:36 msgpack==1.2.4 00:06:36 multi_key_dict==2.0.4 00:06:36 multidict==7.1.0 00:06:36 munch==4.0.0 00:06:36 netaddr==1.3.0 00:06:36 niet==1.4.2 00:06:36 nodeenv==1.12.0 00:06:36 oauth2client==4.1.3 00:06:36 oauthlib==4.0.1 00:06:36 openstacksdk==4.13.0 00:06:36 os-service-types==1.8.2 00:06:36 osc-lib==4.6.0 00:06:36 oslo.config==10.4.0 00:06:36 oslo.context==6.4.0 00:06:36 oslo.i18n==6.8.0 00:06:36 oslo.log==8.2.0 00:06:36 oslo.serialization==5.10.0 00:06:36 oslo.utils==10.1.1 00:06:36 packaging==26.3 00:06:36 pbr==7.1.3 00:06:36 platformdirs==4.12.4 00:06:36 prettytable==3.18.0 00:06:36 propcache==0.5.4 00:06:36 psutil==7.2.2 00:06:36 pyasn1==0.6.5 00:06:36 pyasn1_modules==0.4.2 00:06:36 pycparser==3.11 00:06:36 pygerrit2==2.0.15 00:06:36 PyGithub==2.10.0 00:06:36 Pygments==2.21.0 00:06:36 PyJWT==2.15.1 00:06:36 PyNaCl==1.6.2 00:06:36 pyparsing==2.4.7 00:06:36 pyperclip==1.11.0 00:06:36 pyrsistent==0.20.0 00:06:36 python-cinderclient==9.9.0 00:06:36 python-dateutil==3.0.0 00:06:36 python-discovery==1.9.5 00:06:36 python-heatclient==5.2.0 00:06:36 python-jenkins==1.8.3 00:06:36 python-keystoneclient==6.0.0 00:06:36 python-magnumclient==4.11.0 00:06:36 python-openstackclient==10.0.0 00:06:36 python-swiftclient==4.11.0 00:06:36 PyYAML==6.0.3 00:06:36 referencing==0.37.0 00:06:36 requests==2.34.2 00:06:36 requests-oauthlib==2.0.0 00:06:36 rfc3986==2.0.0 00:06:36 rich==15.0.0 00:06:36 rich-argparse==1.8.0 00:06:36 rpds-py==0.30.0 00:06:36 rsa==4.9.1 00:06:36 ruamel.yaml==0.19.1 00:06:36 ruamel.yaml.clib==0.2.15 00:06:36 s3transfer==0.19.3 00:06:36 simplejson==4.3.0 00:06:36 six==1.17.0 00:06:36 smmap==5.0.3 00:06:36 soupsieve==2.10 00:06:36 stevedore==5.8.0 00:06:36 tabulate==0.10.0 00:06:36 toml==0.10.2 00:06:36 tomlkit==0.15.2 00:06:36 tqdm==4.70.1 00:06:36 typing_extensions==4.16.0 00:06:36 tzdata==2026.6 00:06:36 urllib3==1.26.20 00:06:36 virtualenv==21.15.6 00:06:36 wcwidth==0.9.4 00:06:36 websocket-client==1.9.2 00:06:36 wrapt==2.5.2 00:06:36 xdg==6.0.0 00:06:36 xmltodict==1.0.4 00:06:36 yarl==1.25.1 00:06:36 yq==4.4.5 00:06:36 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins5615962407665111033.sh 00:06:36 ---> uv-install.sh 00:06:36 Installing uv/uvx (latest) using shell installer 00:06:43 2026-11-12 00:06:43 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-qh3TIy.sh" [1] 00:06:43 downloading uv 0.13.7 x86_64-unknown-linux-gnu 00:06:47 installing to /home/jenkins/.local/bin 00:06:47 uv 00:06:47 uvx 00:06:47 everything's installed! 00:06:47 ---> Validating uv/uvx install 00:06:47 uvx 0.13.7 (x86_64-unknown-linux-gnu) 00:06:47 [EnvInject] - Injecting environment variables from a build step. 00:06:47 [EnvInject] - Injecting as environment variables the properties content 00:06:47 OS_CLOUD=vex 00:06:47 00:06:47 [EnvInject] - Variables injected successfully. 00:06:47 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 00:06:47 Run condition [Boolean condition] enabling perform for step [Execute shell] 00:06:47 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins2436168493259797311.sh 00:06:47 ---> Orphaned k8s clusters 00:06:47 Setup pyenv: 00:06:47 system 00:06:47 3.8.13 00:06:47 3.9.13 00:06:47 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:06:47 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-rfoT from file:/tmp/.os_lf_venv 00:06:47 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:06:52 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 00:07:18 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 00:07:18 botocore 1.44.0 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 00:07:19 lf-activate-venv(): INFO: Adding /tmp/venv-rfoT/bin to PATH 00:07:29 -----> Delete orphaned cluster 00:07:29 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 00:07:29 Run condition [Boolean condition] enabling perform for step [Execute shell] 00:07:29 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins2746372296835157829.sh 00:07:29 ---> Orphaned stacks 00:07:29 Setup pyenv: 00:07:29 system 00:07:29 3.8.13 00:07:29 3.9.13 00:07:29 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:07:30 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-rfoT from file:/tmp/.os_lf_venv 00:07:30 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:07:35 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 00:08:05 lf-activate-venv(): INFO: Adding /tmp/venv-rfoT/bin to PATH 00:08:05 + mapfile -t OS_COE_CLUSTERS_ID 00:08:05 ++ awk '{print $1}' 00:08:05 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 00:08:05 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 00:08:15 + echo '-----> Active clusters -> stacks' 00:08:15 -----> Active clusters -> stacks 00:08:15 + OS_COE_STACKS=() 00:08:15 + [[ 0 -gt 0 ]] 00:08:15 + mapfile -t OS_STACKS 00:08:15 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 00:08:15 ++ awk '{print $1}' 00:08:24 + echo '-----> Active stacks' 00:08:24 -----> Active stacks 00:08:24 + echo '-----> Delete orphaned stacks' 00:08:24 -----> Delete orphaned stacks 00:08:24 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 00:08:24 Run condition [Boolean condition] enabling perform for step [Execute shell] 00:08:24 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7589963997112399067.sh 00:08:25 ---> Orphaned servers 00:08:25 Setup pyenv: 00:08:25 system 00:08:25 3.8.13 00:08:25 3.9.13 00:08:25 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:08:25 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-rfoT from file:/tmp/.os_lf_venv 00:08:25 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:08:30 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 00:11:04 WARNING: Connection interrupted while downloading. 00:11:04 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 1) 00:11:07 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 2) 00:11:10 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 3) 00:11:13 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 4) 00:11:16 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 5) 00:11:19 error: incomplete-download 00:11:19 00:11:19 × Download failed after 6 attempts because not enough bytes were received (7.9 MB/13.4 MB) 00:11:19 ╰─> URL: https://nexus3.o-ran-sc.org/repository/PyPi/packages/botocore/1.37.20/botocore-1.37.20-py3-none-any.whl#sha256=c34f4f25fda7c4f726adf5a948590bd6bd7892c05278d31e344b5908e7b43301 00:11:19 00:11:19 note: This is an issue with network connectivity, not pip. 00:11:19 hint: Use --resume-retries to configure resume attempt limit. 00:11:21 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 00:15:01 Build timed out (after 10 minutes). Marking the build as failed. 00:15:01 $ ssh-agent -k 00:15:01 unset SSH_AUTH_SOCK; 00:15:01 unset SSH_AGENT_PID; 00:15:01 echo Agent pid 5178 killed; 00:15:01 [ssh-agent] Stopped. 00:15:01 Build was aborted 00:15:01 [PostBuildScript] - [INFO] Executing post build scripts. 00:15:01 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10100401224535914704.sh 00:15:01 ---> sysstat.sh 00:15:01 /home/jenkins/lf-env.sh: line 73: 6648 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 00:15:01 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 00:15:01 /tmp/jenkins7589963997112399067.sh: line 67: openstack: command not found 00:15:02 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins17257169391550948722.sh 00:15:02 ---> package-listing.sh 00:15:02 ++ facter osfamily 00:15:02 ++ tr '[:upper:]' '[:lower:]' 00:15:03 + OS_FAMILY=redhat 00:15:03 + workspace=/w/workspace/ci-management-openstack-cron 00:15:03 + START_PACKAGES=/tmp/packages_start.txt 00:15:03 + END_PACKAGES=/tmp/packages_end.txt 00:15:03 + DIFF_PACKAGES=/tmp/packages_diff.txt 00:15:03 + PACKAGES=/tmp/packages_start.txt 00:15:03 + '[' /w/workspace/ci-management-openstack-cron ']' 00:15:03 + PACKAGES=/tmp/packages_end.txt 00:15:03 + case "${OS_FAMILY}" in 00:15:03 + rpm -qa 00:15:03 + sort 00:15:10 + '[' -f /tmp/packages_start.txt ']' 00:15:10 + '[' -f /tmp/packages_end.txt ']' 00:15:10 + diff /tmp/packages_start.txt /tmp/packages_end.txt 00:15:10 + '[' /w/workspace/ci-management-openstack-cron ']' 00:15:10 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 00:15:10 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 00:15:10 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7722274461562347196.sh 00:15:10 ---> capture-instance-metadata.sh 00:15:10 Setup pyenv: 00:15:10 system 00:15:10 3.8.13 00:15:10 3.9.13 00:15:10 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:15:10 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-rfoT from file:/tmp/.os_lf_venv 00:15:10 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:15:14 lf-activate-venv(): INFO: Installing additional packages: lftools 00:15:30 lf-activate-venv(): INFO: Adding /tmp/venv-rfoT/bin to PATH 00:15:30 INFO: Running in OpenStack, capturing instance metadata 00:15:30 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6635947448778465082.sh 00:15:30 provisioning config files... 00:15:30 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config1138572747183976983tmp 00:15:30 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 00:15:30 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 00:15:30 [EnvInject] - Injecting environment variables from a build step. 00:15:30 [EnvInject] - Injecting as environment variables the properties content 00:15:30 SERVER_ID=logs 00:15:30 00:15:30 [EnvInject] - Variables injected successfully. 00:15:30 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16599792287979362416.sh 00:15:30 ---> create-netrc.sh 00:15:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9080891607677510653.sh 00:15:31 ---> python-tools-install.sh 00:15:31 Setup pyenv: 00:15:31 system 00:15:31 3.8.13 00:15:31 3.9.13 00:15:31 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:15:31 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-rfoT from file:/tmp/.os_lf_venv 00:15:31 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:15:36 lf-activate-venv(): INFO: Installing additional packages: lftools 00:15:51 lf-activate-venv(): INFO: Adding /tmp/venv-rfoT/bin to PATH 00:15:51 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins3020929063764358436.sh 00:15:51 ---> uv-install.sh 00:15:51 uv 0.13.7 is already installed 00:15:51 uvx 0.13.7 (x86_64-unknown-linux-gnu) 00:15:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16125113614595333926.sh 00:15:51 ---> sudo-logs.sh 00:15:51 Archiving 'sudo' log.. 00:15:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2922139516198804282.sh 00:15:51 ---> job-cost.sh 00:15:51 INFO: Activating Python virtual environment... 00:15:51 Setup pyenv: 00:15:51 system 00:15:51 3.8.13 00:15:51 3.9.13 00:15:51 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:15:52 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-rfoT from file:/tmp/.os_lf_venv 00:15:52 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:15:57 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 00:16:09 lf-activate-venv(): INFO: Adding /tmp/venv-rfoT/bin to PATH 00:16:09 INFO: No stack-cost file found 00:16:09 INFO: Instance uptime: 749s 00:16:09 INFO: Fetching instance metadata (attempt 1 of 3)... 00:16:09 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 00:16:09 INFO: Successfully fetched instance metadata 00:16:09 INFO: Instance type: v3-starter-2 00:16:09 INFO: Retrieving pricing info for: v3-starter-2 00:16:09 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 00:16:09 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=749 00:16:12 INFO: Successfully fetched Vexxhost pricing API 00:16:12 INFO: Retrieved cost: 0.02 00:16:12 INFO: Retrieved resource: v3-starter-2 00:16:12 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 00:16:12 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 00:16:12 INFO: Successfully archived job cost data 00:16:12 DEBUG: Cost data: ci-management-openstack-cron,63781,2026-11-12 00:16:12,v3-starter-2,749,0.02,0.00,FAILURE 00:16:12 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins12516787004652022384.sh 00:16:12 ---> logs-deploy.sh 00:16:12 Setup pyenv: 00:16:12 system 00:16:12 3.8.13 00:16:12 3.9.13 00:16:12 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:16:13 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-rfoT from file:/tmp/.os_lf_venv 00:16:13 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:16:18 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 00:16:33 lf-activate-venv(): INFO: Adding /tmp/venv-rfoT/bin to PATH 00:16:33 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63781 00:16:33 INFO: archiving workspace using pattern(s): 00:16:38 Archives upload complete. 00:16:38 INFO: archiving logs to Nexus 00:16:39 ---> uname -a: 00:16:39 Linux prd-centos8-builder-2c-4g-2495.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 00:16:39 00:16:39 00:16:39 ---> lscpu: 00:16:39 Architecture: x86_64 00:16:39 CPU op-mode(s): 32-bit, 64-bit 00:16:39 Byte Order: Little Endian 00:16:39 CPU(s): 2 00:16:39 On-line CPU(s) list: 0,1 00:16:39 Thread(s) per core: 1 00:16:39 Core(s) per socket: 1 00:16:39 Socket(s): 2 00:16:39 NUMA node(s): 1 00:16:39 Vendor ID: AuthenticAMD 00:16:39 CPU family: 23 00:16:39 Model: 49 00:16:39 Model name: AMD EPYC-Rome Processor 00:16:39 Stepping: 0 00:16:39 CPU MHz: 2799.998 00:16:39 BogoMIPS: 5599.99 00:16:39 Virtualization: AMD-V 00:16:39 Hypervisor vendor: KVM 00:16:39 Virtualization type: full 00:16:39 L1d cache: 32K 00:16:39 L1i cache: 32K 00:16:39 L2 cache: 512K 00:16:39 L3 cache: 16384K 00:16:39 NUMA node0 CPU(s): 0,1 00:16:39 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 00:16:39 00:16:39 00:16:39 ---> nproc: 00:16:39 2 00:16:39 00:16:39 00:16:39 ---> df -h: 00:16:39 Filesystem Size Used Avail Use% Mounted on 00:16:39 devtmpfs 1.8G 0 1.8G 0% /dev 00:16:39 tmpfs 1.8G 0 1.8G 0% /dev/shm 00:16:39 tmpfs 1.8G 17M 1.8G 1% /run 00:16:39 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 00:16:39 /dev/vda1 20G 15G 5.4G 74% / 00:16:39 tmpfs 367M 0 367M 0% /run/user/1001 00:16:39 00:16:39 00:16:39 ---> free -m: 00:16:39 total used free shared buff/cache available 00:16:39 Mem: 3665 464 1229 17 1971 2901 00:16:39 Swap: 1023 0 1023 00:16:39 00:16:39 00:16:39 ---> ip addr: 00:16:39 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 00:16:39 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 00:16:39 inet 127.0.0.1/8 scope host lo 00:16:39 valid_lft forever preferred_lft forever 00:16:39 inet6 ::1/128 scope host 00:16:39 valid_lft forever preferred_lft forever 00:16:39 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 00:16:39 link/ether fa:16:3e:43:94:ed brd ff:ff:ff:ff:ff:ff 00:16:39 altname enp0s3 00:16:39 altname ens3 00:16:39 inet 10.32.7.30/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 00:16:39 valid_lft 85652sec preferred_lft 85652sec 00:16:39 inet6 fe80::f816:3eff:fe43:94ed/64 scope link 00:16:39 valid_lft forever preferred_lft forever 00:16:39 00:16:39 00:16:39 ---> sar -b -r -n DEV: 00:16:39 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/12/2026 _x86_64_ (2 CPU) 00:16:39 00:16:39 00:03:48 LINUX RESTART (2 CPU) 00:16:39 00:16:39 12:05:01 AM tps rtps wtps bread/s bwrtn/s 00:16:39 12:06:01 AM 55.53 6.03 49.50 926.09 5409.88 00:16:39 12:07:01 AM 63.19 0.75 62.44 202.17 9526.94 00:16:39 12:08:02 AM 43.45 0.47 42.99 60.11 11812.35 00:16:39 12:09:01 AM 46.86 0.05 46.81 1.36 24771.07 00:16:39 12:10:01 AM 122.05 1.90 120.15 188.12 174453.84 00:16:39 12:11:01 AM 125.32 2.96 122.35 213.99 170469.85 00:16:39 12:12:01 AM 51.61 3.47 48.14 512.98 16660.37 00:16:39 12:13:01 AM 85.55 0.07 85.49 2.13 2184.42 00:16:39 12:14:01 AM 75.61 0.05 75.56 1.60 2053.48 00:16:39 12:15:01 AM 80.47 0.03 80.44 1.07 2151.20 00:16:39 12:16:01 AM 111.55 90.72 20.83 8127.82 655.35 00:16:39 Average: 78.34 9.70 68.65 932.01 38234.82 00:16:39 00:16:39 12:05:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 00:16:39 12:06:01 AM 1388800 3035848 2364876 63.00 2104 1815888 592248 12.33 136384 1939980 138048 00:16:39 12:07:01 AM 1055188 2961560 2698488 71.89 2104 2065780 632056 13.16 138668 2233744 153672 00:16:39 12:08:02 AM 701416 2841976 3052260 81.31 2104 2295380 741392 15.44 160360 2550968 149416 00:16:39 12:09:01 AM 128228 2862624 3625448 96.58 2104 2892096 725200 15.10 186044 3106152 165244 00:16:39 12:10:01 AM 124812 2827688 3628864 96.67 2104 2855704 778036 16.20 246504 3064000 157936 00:16:39 12:11:01 AM 120640 2791776 3633036 96.79 2104 2819264 839112 17.47 296408 3038492 200048 00:16:39 12:12:01 AM 1569176 2921088 2184500 58.20 2104 1500812 719848 14.99 178652 1711544 2564 00:16:39 12:13:01 AM 1507576 2884240 2246100 59.84 2104 1520604 742260 15.46 186740 1750204 4316 00:16:39 12:14:01 AM 1442140 2838752 2311536 61.58 2104 1536688 773140 16.10 193176 1796784 3460 00:16:39 12:15:01 AM 1373580 2791868 2380096 63.41 2104 1554224 818552 17.05 200196 1844380 3356 00:16:39 12:16:01 AM 1336376 3007216 2417300 64.40 2104 1805240 587704 12.24 216436 1859548 9588 00:16:39 Average: 977085 2887694 2776591 73.97 2104 2060153 722686 15.05 194506 2263254 89786 00:16:39 00:16:39 12:05:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 00:16:39 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:06:01 AM eth0 46.68 39.77 891.60 4.63 0.00 0.00 0.00 0.00 00:16:39 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:07:01 AM eth0 66.20 57.29 1021.55 7.28 0.00 0.00 0.00 0.00 00:16:39 12:08:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:08:02 AM eth0 39.97 36.37 736.79 5.61 0.00 0.00 0.00 0.00 00:16:39 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:09:01 AM eth0 330.11 253.55 6071.35 23.18 0.00 0.00 0.00 0.00 00:16:39 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:10:01 AM eth0 1926.59 1466.08 43775.91 100.32 0.00 0.00 0.00 0.00 00:16:39 12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:11:01 AM eth0 1864.36 1426.90 43065.30 97.95 0.00 0.00 0.00 0.00 00:16:39 12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:12:01 AM eth0 149.91 98.13 2405.23 11.60 0.00 0.00 0.00 0.00 00:16:39 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:13:01 AM eth0 54.44 37.61 123.76 12.89 0.00 0.00 0.00 0.00 00:16:39 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:14:01 AM eth0 42.69 30.36 101.89 10.42 0.00 0.00 0.00 0.00 00:16:39 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:15:01 AM eth0 47.52 33.86 105.59 11.51 0.00 0.00 0.00 0.00 00:16:39 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 12:16:01 AM eth0 14.53 13.45 11.10 6.67 0.00 0.00 0.00 0.00 00:16:39 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:39 Average: eth0 416.98 317.84 8946.52 26.57 0.00 0.00 0.00 0.00 00:16:39 00:16:39 00:16:39 ---> sar -P ALL: 00:16:39 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/12/2026 _x86_64_ (2 CPU) 00:16:39 00:16:39 00:03:48 LINUX RESTART (2 CPU) 00:16:39 00:16:39 12:05:01 AM CPU %user %nice %system %iowait %steal %idle 00:16:39 12:06:01 AM all 24.67 0.00 3.19 1.05 0.08 71.01 00:16:39 12:06:01 AM 0 17.83 0.00 2.10 1.13 0.08 78.85 00:16:39 12:06:01 AM 1 31.51 0.00 4.27 0.97 0.08 63.17 00:16:39 12:07:01 AM all 24.16 0.00 3.28 1.78 0.08 70.70 00:16:39 12:07:01 AM 0 14.50 0.00 2.70 2.04 0.07 80.69 00:16:39 12:07:01 AM 1 33.81 0.00 3.86 1.52 0.10 60.71 00:16:39 12:08:02 AM all 30.59 0.00 3.13 1.12 0.08 65.08 00:16:39 12:08:02 AM 0 25.95 0.00 3.12 1.10 0.08 69.74 00:16:39 12:08:02 AM 1 35.21 0.00 3.13 1.13 0.08 60.44 00:16:39 12:09:01 AM all 21.71 0.00 3.31 1.52 0.08 73.38 00:16:39 12:09:01 AM 0 19.07 0.00 3.27 1.58 0.07 76.01 00:16:39 12:09:01 AM 1 24.34 0.00 3.34 1.46 0.08 70.77 00:16:39 12:10:01 AM all 21.97 0.00 12.76 3.22 0.11 61.94 00:16:39 12:10:01 AM 0 20.24 0.00 12.95 3.43 0.12 63.25 00:16:39 12:10:01 AM 1 23.67 0.00 12.58 3.01 0.10 60.65 00:16:39 12:11:01 AM all 21.46 0.00 12.61 3.17 0.10 62.66 00:16:39 12:11:01 AM 0 18.61 0.00 12.03 3.04 0.10 66.21 00:16:39 12:11:01 AM 1 24.25 0.00 13.17 3.30 0.10 59.17 00:16:39 12:12:01 AM all 23.46 0.00 2.13 0.62 0.08 73.72 00:16:39 12:12:01 AM 0 10.46 0.00 1.41 0.27 0.07 87.80 00:16:39 12:12:01 AM 1 36.44 0.00 2.86 0.97 0.08 59.65 00:16:39 12:13:01 AM all 38.57 0.00 1.50 0.49 0.13 59.32 00:16:39 12:13:01 AM 0 18.86 0.00 1.17 0.22 0.10 79.65 00:16:39 12:13:01 AM 1 58.26 0.00 1.82 0.77 0.15 39.00 00:16:39 12:14:01 AM all 40.62 0.00 1.39 0.42 0.11 57.47 00:16:39 12:14:01 AM 0 15.34 0.00 1.09 0.27 0.08 83.22 00:16:39 12:14:01 AM 1 65.87 0.00 1.69 0.57 0.13 31.74 00:16:39 12:15:01 AM all 39.74 0.00 1.44 0.55 0.11 58.17 00:16:39 12:15:01 AM 0 9.20 0.00 1.07 0.50 0.08 89.15 00:16:39 12:15:01 AM 1 70.24 0.00 1.80 0.60 0.13 27.22 00:16:39 12:16:01 AM all 22.95 0.00 2.68 6.14 0.08 68.17 00:16:39 12:16:01 AM 0 20.06 0.00 2.88 6.90 0.07 70.10 00:16:39 12:16:01 AM 1 25.83 0.00 2.47 5.38 0.08 66.24 00:16:39 00:16:39 Average: CPU %user %nice %system %iowait %steal %idle 00:16:39 Average: all 28.20 0.00 4.29 1.82 0.09 65.60 00:16:39 Average: 0 17.27 0.00 3.95 1.86 0.08 76.84 00:16:39 Average: 1 39.07 0.00 4.63 1.79 0.10 54.41 00:16:39 00:16:39 00:16:39