22:04:42  Started by timer
22:04:42  Running as SYSTEM
22:04:42  [EnvInject] - Loading node environment variables.
22:04:42  Building remotely on prd-centos8-builder-2c-4g-2414 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
22:04:42  [ssh-agent] Looking for ssh-agent implementation...
22:04:43  $ ssh-agent
22:04:43  SSH_AUTH_SOCK=/tmp/ssh-bWdnZcTiqjZF/agent.5182
22:04:43  SSH_AGENT_PID=5184
22:04:43  [ssh-agent] Started.
22:04:43  Running ssh-add (command line suppressed)
22:04:43  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_15110285231814220898.key (jenkins-ssh)
22:04:43  [ssh-agent] Using credentials jenkins (jenkins)
22:04:43  The recommended git tool is: NONE
22:04:45  using credential jenkins
22:04:45  Wiping out workspace first.
22:04:45  Cloning the remote Git repository
22:04:45  Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
22:04:45   > git init /w/workspace/ci-management-openstack-cron # timeout=10
22:04:45  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
22:04:45   > git --version # timeout=10
22:04:45   > git --version # 'git version 2.43.0'
22:04:45  using GIT_SSH to set credentials jenkins
22:04:45  [INFO] Currently running in a labeled security context
22:04:45  [INFO] Currently SELinux is 'enforcing' on the host
22:04:45   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh4047341554672849182.key
22:04:45   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
22:04:49   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
22:04:49   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
22:04:49  Avoid second fetch
22:04:49   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
22:04:50  Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master)
22:04:50   > git config core.sparsecheckout # timeout=10
22:04:50   > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
22:04:50  Commit message: "CI: Update github2gerrit caller to v2.4.4"
22:04:50   > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
22:04:50   > git remote # timeout=10
22:04:50   > git submodule init # timeout=10
22:04:50   > git submodule sync # timeout=10
22:04:50   > git config --get remote.origin.url # timeout=10
22:04:50   > git submodule init # timeout=10
22:04:50   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
22:04:50   > git config --get submodule.packer/common-packer.url # timeout=10
22:04:50   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
22:04:50   > git config --get submodule.global-jjb.url # timeout=10
22:04:50   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
22:04:50   > git submodule update --init --recursive packer/common-packer # timeout=10
22:04:54   > git submodule update --init --recursive global-jjb # timeout=10
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
22:05:05  provisioning config files...
22:05:05  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
22:05:05  copy managed file [npmrc] to file:/home/jenkins/.npmrc
22:05:05  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
22:05:05  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16611598217315757135.sh
22:05:05  ---> python-tools-install.sh
22:05:05  Setup pyenv:
22:05:05    system
22:05:05  * 3.8.13 (set by /opt/pyenv/version)
22:05:05  * 3.9.13 (set by /opt/pyenv/version)
22:05:05  * 3.10.6 (set by /opt/pyenv/version)
22:05:10  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-NCuJ
22:05:10  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
22:05:10  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:05:22  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:05:58  lf-activate-venv(): INFO: Adding /tmp/venv-NCuJ/bin to PATH
22:05:58  Generating Requirements File
22:06:41  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:06:41  botocore 1.43.127 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
22:06:41  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
22:06:42  Python 3.10.6
22:06:42  pip 26.3 from /tmp/venv-NCuJ/lib/python3.10/site-packages/pip (python 3.10)
22:06:42  aiohappyeyeballs==2.7.1
22:06:42  aiohttp==3.14.5
22:06:42  aiosignal==1.4.0
22:06:42  appdirs==1.4.4
22:06:42  argcomplete==3.7.2
22:06:42  aspy.yaml==1.3.0
22:06:42  async-timeout==5.0.1
22:06:42  attrs==26.1.0
22:06:42  autopage==0.6.0
22:06:42  backports.strenum==1.3.1
22:06:42  beautifulsoup4==4.15.0
22:06:42  boto3==1.43.127
22:06:42  botocore==1.43.127
22:06:42  bs4==0.0.2
22:06:42  certifi==2026.10.23
22:06:42  cffi==2.1.1
22:06:42  cfgv==3.5.0
22:06:42  chardet==7.7.0
22:06:42  charset-normalizer==3.5.2
22:06:42  click==8.5.1
22:06:42  cliff==4.14.0
22:06:42  cmd2==3.5.1
22:06:42  cryptography==3.3.2
22:06:42  debtcollector==3.1.0
22:06:42  decorator==5.3.1
22:06:42  defusedxml==0.7.1
22:06:42  Deprecated==1.3.1
22:06:42  distlib==0.4.4
22:06:42  dnspython==2.8.0
22:06:42  docker==7.2.0
22:06:42  dogpile.cache==1.5.0
22:06:42  durationpy==0.11
22:06:42  email-validator==2.3.0
22:06:42  filelock==4.1.0
22:06:42  frozenlist==1.8.0
22:06:42  future==1.0.0
22:06:42  gitdb==4.0.12
22:06:42  GitPython==3.2.1
22:06:42  httplib2==0.30.2
22:06:42  identify==2.6.20
22:06:42  idna==3.20
22:06:42  importlib-resources==1.5.0
22:06:42  iso8601==2.1.0
22:06:42  Jinja2==3.1.6
22:06:42  jmespath==1.1.0
22:06:42  jsonpatch==1.45
22:06:42  jsonpointer==3.10
22:06:42  jsonschema==4.26.0
22:06:42  jsonschema-specifications==2025.9.1
22:06:42  keystoneauth1==5.14.0
22:06:42  kubernetes==36.0.3
22:06:42  lftools==0.37.26
22:06:42  lxml==6.1.3
22:06:42  markdown-it-py==4.3.0
22:06:42  MarkupSafe==3.0.4
22:06:42  mdurl==0.1.2
22:06:42  msgpack==1.2.4
22:06:42  multi_key_dict==2.0.4
22:06:42  multidict==7.1.0
22:06:42  munch==4.0.0
22:06:42  netaddr==1.3.0
22:06:42  niet==1.4.2
22:06:42  nodeenv==1.12.0
22:06:42  oauth2client==4.1.3
22:06:42  oauthlib==4.0.1
22:06:42  openstacksdk==4.13.0
22:06:42  os-service-types==1.8.2
22:06:42  osc-lib==4.6.0
22:06:42  oslo.config==10.4.0
22:06:42  oslo.context==6.4.0
22:06:42  oslo.i18n==6.8.0
22:06:42  oslo.log==8.2.0
22:06:42  oslo.serialization==5.10.0
22:06:42  oslo.utils==10.1.1
22:06:42  packaging==26.3
22:06:42  pbr==7.1.3
22:06:42  platformdirs==4.12.4
22:06:42  prettytable==3.18.0
22:06:42  propcache==0.5.4
22:06:42  psutil==7.2.2
22:06:42  pyasn1==0.6.5
22:06:42  pyasn1_modules==0.4.2
22:06:42  pycparser==3.11
22:06:42  pygerrit2==2.0.15
22:06:42  PyGithub==2.10.0
22:06:42  Pygments==2.21.0
22:06:42  PyJWT==2.15.1
22:06:42  PyNaCl==1.6.2
22:06:42  pyparsing==2.4.7
22:06:42  pyperclip==1.11.0
22:06:42  pyrsistent==0.20.0
22:06:42  python-cinderclient==9.9.0
22:06:42  python-dateutil==3.0.0
22:06:42  python-discovery==1.9.5
22:06:42  python-heatclient==5.2.0
22:06:42  python-jenkins==1.8.3
22:06:42  python-keystoneclient==6.0.0
22:06:42  python-magnumclient==4.11.0
22:06:42  python-openstackclient==10.0.0
22:06:42  python-swiftclient==4.11.0
22:06:42  PyYAML==6.0.3
22:06:42  referencing==0.37.0
22:06:42  requests==2.34.2
22:06:42  requests-oauthlib==2.0.0
22:06:42  rfc3986==2.0.0
22:06:42  rich==15.0.0
22:06:42  rich-argparse==1.8.0
22:06:42  rpds-py==0.30.0
22:06:42  rsa==4.9.1
22:06:42  ruamel.yaml==0.19.1
22:06:42  ruamel.yaml.clib==0.2.15
22:06:42  s3transfer==0.19.3
22:06:42  simplejson==4.2.0
22:06:42  six==1.17.0
22:06:42  smmap==5.0.3
22:06:42  soupsieve==2.10
22:06:42  stevedore==5.8.0
22:06:42  tabulate==0.10.0
22:06:42  toml==0.10.2
22:06:42  tomlkit==0.15.2
22:06:42  tqdm==4.70.1
22:06:42  typing_extensions==4.16.0
22:06:42  tzdata==2026.6
22:06:42  urllib3==1.26.20
22:06:42  virtualenv==21.15.6
22:06:42  wcwidth==0.9.4
22:06:42  websocket-client==1.9.2
22:06:42  wrapt==2.5.2
22:06:42  xdg==6.0.0
22:06:42  xmltodict==1.0.4
22:06:42  yarl==1.25.1
22:06:42  yq==4.4.5
22:06:42  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins10123088937340392521.sh
22:06:42  ---> uv-install.sh
22:06:42  Installing uv/uvx (latest) using shell installer
22:06:49  2026-11-10 22:06:49 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-vaOgS6.sh" [1]
22:06:49  downloading uv 0.13.7 x86_64-unknown-linux-gnu
22:06:53  installing to /home/jenkins/.local/bin
22:06:53    uv
22:06:53    uvx
22:06:53  everything's installed!
22:06:53  ---> Validating uv/uvx install
22:06:53  uvx 0.13.7 (x86_64-unknown-linux-gnu)
22:06:53  [EnvInject] - Injecting environment variables from a build step.
22:06:53  [EnvInject] - Injecting as environment variables the properties content 
22:06:53  OS_CLOUD=vex
22:06:53  
22:06:53  [EnvInject] - Variables injected successfully.
22:06:53  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:06:53  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:06:53  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins2267122068308246281.sh
22:06:53  ---> Orphaned k8s clusters
22:06:53  Setup pyenv:
22:06:54    system
22:06:54    3.8.13
22:06:54    3.9.13
22:06:54  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:06:54  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NCuJ from file:/tmp/.os_lf_venv
22:06:54  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:06:59  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
22:07:28  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:07:28  botocore 1.43.127 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
22:07:29  lf-activate-venv(): INFO: Adding /tmp/venv-NCuJ/bin to PATH
22:07:40  -----> Delete orphaned cluster
22:07:40  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:07:40  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:07:40  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3608404424445224973.sh
22:07:40  ---> Orphaned stacks
22:07:40  Setup pyenv:
22:07:40    system
22:07:40    3.8.13
22:07:40    3.9.13
22:07:40  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:07:40  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NCuJ from file:/tmp/.os_lf_venv
22:07:40  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:07:45  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
22:08:17  lf-activate-venv(): INFO: Adding /tmp/venv-NCuJ/bin to PATH
22:08:17  + mapfile -t OS_COE_CLUSTERS_ID
22:08:17  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
22:08:17  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
22:08:17  ++ awk '{print $1}'
22:08:27  + echo '-----> Active clusters -> stacks'
22:08:27  -----> Active clusters -> stacks
22:08:27  + OS_COE_STACKS=()
22:08:27  + [[ 0 -gt 0 ]]
22:08:27  + mapfile -t OS_STACKS
22:08:27  ++ awk '{print $1}'
22:08:27  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
22:08:36  + echo '-----> Active stacks'
22:08:36  -----> Active stacks
22:08:36  + echo '-----> Delete orphaned stacks'
22:08:36  -----> Delete orphaned stacks
22:08:36  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:08:36  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:08:36  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins6462263882083245179.sh
22:08:36  ---> Orphaned servers
22:08:36  Setup pyenv:
22:08:36    system
22:08:36    3.8.13
22:08:36    3.9.13
22:08:37  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:08:37  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NCuJ from file:/tmp/.os_lf_venv
22:08:37  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:08:42  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:11:20  ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device
22:11:20  
22:11:22  lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple
22:15:05  Build timed out (after 10 minutes). Marking the build as failed.
22:15:05  $ ssh-agent -k
22:15:05  unset SSH_AUTH_SOCK;
22:15:05  unset SSH_AGENT_PID;
22:15:05  echo Agent pid 5184 killed;
22:15:05  [ssh-agent] Stopped.
22:15:05  Build was aborted
22:15:05  [PostBuildScript] - [INFO] Executing post build scripts.
22:15:05  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10880166132900887451.sh
22:15:05  ---> sysstat.sh
22:15:05  /home/jenkins/lf-env.sh: line 73:  6649 Terminated              "$venv_python" -m pip install --index-url "$upstream" "$@"
22:15:05  lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:15:05  /tmp/jenkins6462263882083245179.sh: line 67: openstack: command not found
22:15:06  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10962556205675118991.sh
22:15:06  ---> package-listing.sh
22:15:06  ++ facter osfamily
22:15:06  ++ tr '[:upper:]' '[:lower:]'
22:15:07  + OS_FAMILY=redhat
22:15:07  + workspace=/w/workspace/ci-management-openstack-cron
22:15:07  + START_PACKAGES=/tmp/packages_start.txt
22:15:07  + END_PACKAGES=/tmp/packages_end.txt
22:15:07  + DIFF_PACKAGES=/tmp/packages_diff.txt
22:15:07  + PACKAGES=/tmp/packages_start.txt
22:15:07  + '[' /w/workspace/ci-management-openstack-cron ']'
22:15:07  + PACKAGES=/tmp/packages_end.txt
22:15:07  + case "${OS_FAMILY}" in
22:15:07  + rpm -qa
22:15:07  + sort
22:15:14  + '[' -f /tmp/packages_start.txt ']'
22:15:14  + '[' -f /tmp/packages_end.txt ']'
22:15:14  + diff /tmp/packages_start.txt /tmp/packages_end.txt
22:15:14  + '[' /w/workspace/ci-management-openstack-cron ']'
22:15:14  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
22:15:14  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
22:15:14  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13028510322260216920.sh
22:15:14  ---> capture-instance-metadata.sh
22:15:14  Setup pyenv:
22:15:14    system
22:15:14    3.8.13
22:15:14    3.9.13
22:15:14  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:15:14  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NCuJ from file:/tmp/.os_lf_venv
22:15:14  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:15:19  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:15:34  lf-activate-venv(): INFO: Adding /tmp/venv-NCuJ/bin to PATH
22:15:34  INFO: Running in OpenStack, capturing instance metadata
22:15:35  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12860071032136640246.sh
22:15:35  provisioning config files...
22:15:35  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config8480294193817968143tmp
22:15:35  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
22:15:35  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
22:15:35  [EnvInject] - Injecting environment variables from a build step.
22:15:35  [EnvInject] - Injecting as environment variables the properties content 
22:15:35  SERVER_ID=logs
22:15:35  
22:15:35  [EnvInject] - Variables injected successfully.
22:15:35  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2146736211276542931.sh
22:15:35  ---> create-netrc.sh
22:15:35  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6339506560272273979.sh
22:15:35  ---> python-tools-install.sh
22:15:35  Setup pyenv:
22:15:35    system
22:15:35    3.8.13
22:15:35    3.9.13
22:15:35  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:15:36  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NCuJ from file:/tmp/.os_lf_venv
22:15:36  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:15:41  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:15:56  lf-activate-venv(): INFO: Adding /tmp/venv-NCuJ/bin to PATH
22:15:56  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins10593795163748406815.sh
22:15:56  ---> uv-install.sh
22:15:56  uv 0.13.7 is already installed
22:15:56  uvx 0.13.7 (x86_64-unknown-linux-gnu)
22:15:56  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins187128087685154159.sh
22:15:56  ---> sudo-logs.sh
22:15:56  Archiving 'sudo' log..
22:15:56  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4078460356600903142.sh
22:15:56  ---> job-cost.sh
22:15:56  INFO: Activating Python virtual environment...
22:15:56  Setup pyenv:
22:15:56    system
22:15:56    3.8.13
22:15:56    3.9.13
22:15:56  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:15:57  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NCuJ from file:/tmp/.os_lf_venv
22:15:57  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:16:02  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
22:16:14  lf-activate-venv(): INFO: Adding /tmp/venv-NCuJ/bin to PATH
22:16:14  INFO: No stack-cost file found
22:16:14  INFO: Instance uptime: 750s
22:16:14  INFO: Fetching instance metadata (attempt 1 of 3)...
22:16:14  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
22:16:14  INFO: Successfully fetched instance metadata
22:16:14  INFO: Instance type: v3-starter-2
22:16:14  INFO: Retrieving pricing info for: v3-starter-2
22:16:14  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
22:16:14  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=750
22:16:17  INFO: Successfully fetched Vexxhost pricing API
22:16:17  INFO: Retrieved cost: 0.02
22:16:17  INFO: Retrieved resource: v3-starter-2
22:16:17  INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost
22:16:17  INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv
22:16:17  INFO: Successfully archived job cost data
22:16:17  DEBUG: Cost data: ci-management-openstack-cron,63755,2026-11-10 22:16:17,v3-starter-2,750,0.02,0.00,FAILURE
22:16:17  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins4761689443969131467.sh
22:16:17  ---> logs-deploy.sh
22:16:17  Setup pyenv:
22:16:18    system
22:16:18    3.8.13
22:16:18    3.9.13
22:16:18  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:16:18  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NCuJ from file:/tmp/.os_lf_venv
22:16:18  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:16:23  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
22:16:38  lf-activate-venv(): INFO: Adding /tmp/venv-NCuJ/bin to PATH
22:16:38  INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63755
22:16:38  INFO: archiving workspace using pattern(s): 
22:16:41  Archives upload complete.
22:16:41  INFO: archiving logs to Nexus
22:16:42  ---> uname -a:
22:16:42  Linux prd-centos8-builder-2c-4g-2414.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
22:16:42  
22:16:42  
22:16:42  ---> lscpu:
22:16:42  Architecture:        x86_64
22:16:42  CPU op-mode(s):      32-bit, 64-bit
22:16:42  Byte Order:          Little Endian
22:16:42  CPU(s):              2
22:16:42  On-line CPU(s) list: 0,1
22:16:42  Thread(s) per core:  1
22:16:42  Core(s) per socket:  1
22:16:42  Socket(s):           2
22:16:42  NUMA node(s):        1
22:16:42  Vendor ID:           AuthenticAMD
22:16:42  CPU family:          23
22:16:42  Model:               49
22:16:42  Model name:          AMD EPYC-Rome Processor
22:16:42  Stepping:            0
22:16:42  CPU MHz:             2799.998
22:16:42  BogoMIPS:            5599.99
22:16:42  Virtualization:      AMD-V
22:16:42  Hypervisor vendor:   KVM
22:16:42  Virtualization type: full
22:16:42  L1d cache:           32K
22:16:42  L1i cache:           32K
22:16:42  L2 cache:            512K
22:16:42  L3 cache:            16384K
22:16:42  NUMA node0 CPU(s):   0,1
22:16:42  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
22:16:42  
22:16:42  
22:16:42  ---> nproc:
22:16:42  2
22:16:42  
22:16:42  
22:16:42  ---> df -h:
22:16:42  Filesystem      Size  Used Avail Use% Mounted on
22:16:42  devtmpfs        1.8G     0  1.8G   0% /dev
22:16:42  tmpfs           1.8G     0  1.8G   0% /dev/shm
22:16:42  tmpfs           1.8G   17M  1.8G   1% /run
22:16:42  tmpfs           1.8G     0  1.8G   0% /sys/fs/cgroup
22:16:42  /dev/vda1        20G   15G  5.4G  74% /
22:16:42  tmpfs           367M     0  367M   0% /run/user/1001
22:16:42  
22:16:42  
22:16:42  ---> free -m:
22:16:42                total        used        free      shared  buff/cache   available
22:16:42  Mem:           3665         467        1230          17        1967        2901
22:16:42  Swap:          1023           0        1023
22:16:42  
22:16:42  
22:16:42  ---> ip addr:
22:16:42  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
22:16:42      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
22:16:42      inet 127.0.0.1/8 scope host lo
22:16:42         valid_lft forever preferred_lft forever
22:16:42      inet6 ::1/128 scope host 
22:16:42         valid_lft forever preferred_lft forever
22:16:42  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
22:16:42      link/ether fa:16:3e:9a:3e:38 brd ff:ff:ff:ff:ff:ff
22:16:42      altname enp0s3
22:16:42      altname ens3
22:16:42      inet 10.32.6.251/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
22:16:42         valid_lft 85654sec preferred_lft 85654sec
22:16:42      inet6 fe80::f816:3eff:fe9a:3e38/64 scope link 
22:16:42         valid_lft forever preferred_lft forever
22:16:42  
22:16:42  
22:16:42  ---> sar -b -r -n DEV:
22:16:42  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/10/2026 	_x86_64_	(2 CPU)
22:16:42  
22:16:42  22:03:52     LINUX RESTART	(2 CPU)
22:16:42  
22:16:42  10:05:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
22:16:42  10:06:01 PM     64.66      6.40     58.26    934.38   5351.37
22:16:42  10:07:01 PM     61.16      0.70     60.46    201.53   8457.25
22:16:42  10:08:01 PM     44.11      0.50     43.61     60.64  11447.54
22:16:42  10:09:01 PM     37.76      0.05     37.71      1.33   5527.16
22:16:42  10:10:01 PM    104.33      1.47    102.86    303.75 144289.83
22:16:42  10:11:01 PM    125.77      4.51    121.25    379.75 172245.72
22:16:42  10:12:01 PM     80.09      3.63     76.45    494.58  65295.60
22:16:42  10:13:01 PM     65.83      0.05     65.78      1.60   1673.36
22:16:42  10:14:01 PM     60.04      0.08     59.96      2.67   1632.73
22:16:42  10:15:01 PM     56.27      0.03     56.24      1.07   1497.05
22:16:42  10:16:01 PM    113.11     90.84     22.28   8235.12    637.74
22:16:42  Average:        73.92      9.84     64.08    965.12  38015.20
22:16:42  
22:16:42  10:05:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
22:16:42  10:06:01 PM   1387844   3035348   2365832     63.03      2104   1816400    580768     12.09    136340   1940464    136864
22:16:42  10:07:01 PM   1105436   3006564   2648240     70.55      2104   2060560    583172     12.14    139072   2184844    178276
22:16:42  10:08:01 PM    937880   2923484   2815796     75.01      2104   2143908    657728     13.70    151864   2334196     39164
22:16:42  10:09:01 PM    897824   2911880   2855852     76.08      2104   2172396    672184     14.00    179404   2345916     55692
22:16:42  10:10:01 PM    125508   2822208   3628168     96.66      2104   2851520    762720     15.88    228428   3061180    185548
22:16:42  10:11:01 PM    120892   2814052   3632784     96.78      2104   2841296    815420     16.98    279608   3059580    218108
22:16:42  10:12:01 PM   1571484   2922120   2182192     58.13      2104   1499736    714076     14.87    182228   1706680      1928
22:16:42  10:13:01 PM   1534060   2903152   2219616     59.13      2104   1514560    714076     14.87    188152   1727204      3572
22:16:42  10:14:01 PM   1481388   2866408   2272288     60.54      2104   1527572    751648     15.65    193276   1764712      2516
22:16:42  10:15:01 PM   1431316   2831776   2322360     61.87      2104   1539844    774252     16.12    198264   1800504      2464
22:16:42  10:16:01 PM   1340904   3001720   2412772     64.28      2104   1798680    605912     12.62    216396   1865324     13212
22:16:42  Average:      1084958   2912610   2668718     71.10      2104   1978770    693814     14.45    190276   2162782     76122
22:16:42  
22:16:42  10:05:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
22:16:42  10:06:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:06:01 PM      eth0     45.44     39.41    867.41      5.59      0.00      0.00      0.00      0.00
22:16:42  10:07:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:07:01 PM      eth0     68.11     52.83   1044.50      6.59      0.00      0.00      0.00      0.00
22:16:42  10:08:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:08:01 PM      eth0      9.50     10.61     59.02      3.43      0.00      0.00      0.00      0.00
22:16:42  10:09:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:09:01 PM      eth0     40.08     35.59    687.67      5.86      0.00      0.00      0.00      0.00
22:16:42  10:10:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:10:01 PM      eth0   1745.48   1348.21  37201.21     92.14      0.00      0.00      0.00      0.00
22:16:42  10:11:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:11:01 PM      eth0   1954.93   1498.02  43344.68    101.63      0.00      0.00      0.00      0.00
22:16:42  10:12:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:12:01 PM      eth0    741.19    544.18  14589.78     40.77      0.00      0.00      0.00      0.00
22:16:42  10:13:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:13:01 PM      eth0     78.16     36.40     94.97     10.36      0.00      0.00      0.00      0.00
22:16:42  10:14:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:14:01 PM      eth0     66.94     32.53     83.38      8.98      0.00      0.00      0.00      0.00
22:16:42  10:15:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:15:01 PM      eth0     63.77     37.81     80.55      8.96      0.00      0.00      0.00      0.00
22:16:42  10:16:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  10:16:01 PM      eth0     19.16     16.16     17.20     10.52      0.00      0.00      0.00      0.00
22:16:42  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:42  Average:         eth0    439.46    332.07   8918.11     26.81      0.00      0.00      0.00      0.00
22:16:42  
22:16:42  
22:16:42  ---> sar -P ALL:
22:16:42  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/10/2026 	_x86_64_	(2 CPU)
22:16:42  
22:16:42  22:03:52     LINUX RESTART	(2 CPU)
22:16:42  
22:16:42  10:05:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
22:16:42  10:06:01 PM     all     23.58      0.00      3.44      2.31      0.08     70.60
22:16:42  10:06:01 PM       0     26.97      0.00      3.61      2.70      0.08     66.64
22:16:42  10:06:01 PM       1     20.17      0.00      3.26      1.92      0.07     74.58
22:16:42  10:07:01 PM     all     22.40      0.00      3.32      1.93      0.08     72.27
22:16:42  10:07:01 PM       0     35.28      0.00      4.28      1.65      0.10     58.69
22:16:42  10:07:01 PM       1      9.51      0.00      2.36      2.21      0.07     85.86
22:16:42  10:08:01 PM     all     27.44      0.00      2.49      1.58      0.08     68.40
22:16:42  10:08:01 PM       0     25.17      0.00      2.13      1.18      0.07     71.45
22:16:42  10:08:01 PM       1     29.72      0.00      2.86      1.97      0.10     65.35
22:16:42  10:09:01 PM     all     24.19      0.00      2.60      1.35      0.07     71.78
22:16:42  10:09:01 PM       0     35.32      0.00      3.12      1.33      0.08     60.14
22:16:42  10:09:01 PM       1     13.05      0.00      2.09      1.37      0.05     83.44
22:16:42  10:10:01 PM     all     25.80      0.00     10.52      2.35      0.11     61.22
22:16:42  10:10:01 PM       0     29.87      0.00      9.90      2.34      0.12     57.77
22:16:42  10:10:01 PM       1     21.66      0.00     11.15      2.35      0.10     64.74
22:16:42  10:11:01 PM     all     22.15      0.00     12.60      2.63      0.12     62.51
22:16:42  10:11:01 PM       0     22.61      0.00     11.26      2.25      0.12     63.77
22:16:42  10:11:01 PM       1     21.68      0.00     13.96      3.02      0.12     61.22
22:16:42  10:12:01 PM     all     26.93      0.00      5.49      1.22      0.09     66.26
22:16:42  10:12:01 PM       0     40.96      0.00      5.10      1.05      0.10     52.79
22:16:42  10:12:01 PM       1     12.78      0.00      5.90      1.40      0.08     79.84
22:16:42  10:13:01 PM     all     30.99      0.00      1.48      0.31      0.12     67.10
22:16:42  10:13:01 PM       0     50.83      0.00      2.02      0.53      0.13     46.49
22:16:42  10:13:01 PM       1     11.10      0.00      0.94      0.08      0.10     87.78
22:16:42  10:14:01 PM     all     32.43      0.00      1.32      0.29      0.10     65.86
22:16:42  10:14:01 PM       0     45.08      0.00      1.55      0.37      0.12     52.89
22:16:42  10:14:01 PM       1     19.74      0.00      1.09      0.22      0.08     78.87
22:16:42  10:15:01 PM     all     32.47      0.00      1.22      0.29      0.10     65.91
22:16:42  10:15:01 PM       0     44.00      0.00      1.52      0.47      0.12     53.90
22:16:42  10:15:01 PM       1     20.90      0.00      0.92      0.12      0.08     77.97
22:16:42  10:16:01 PM     all     24.13      0.00      2.73      6.26      0.08     66.80
22:16:42  10:16:01 PM       0     30.66      0.00      2.30      0.80      0.08     66.15
22:16:42  10:16:01 PM       1     17.57      0.00      3.17     11.75      0.07     67.44
22:16:42  
22:16:42  Average:        CPU     %user     %nice   %system   %iowait    %steal     %idle
22:16:42  Average:        all     26.60      0.00      4.28      1.86      0.09     67.17
22:16:42  Average:          0     35.16      0.00      4.25      1.33      0.10     59.16
22:16:42  Average:          1     17.98      0.00      4.30      2.40      0.08     75.23
22:16:42  
22:16:42  
22:16:42