20:04:39  Started by timer
20:04:39  Running as SYSTEM
20:04:39  [EnvInject] - Loading node environment variables.
20:04:39  Building remotely on prd-centos8-builder-2c-4g-2324 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
20:04:39  [ssh-agent] Looking for ssh-agent implementation...
20:04:39  $ ssh-agent
20:04:39  SSH_AUTH_SOCK=/tmp/ssh-C6MvmYrM9h94/agent.5168
20:04:39  SSH_AGENT_PID=5170
20:04:39  [ssh-agent] Started.
20:04:39  Running ssh-add (command line suppressed)
20:04:39  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_8921737940470638352.key (jenkins-ssh)
20:04:39  [ssh-agent] Using credentials jenkins (jenkins)
20:04:39  The recommended git tool is: NONE
20:04:41  using credential jenkins
20:04:41  Wiping out workspace first.
20:04:41  Cloning the remote Git repository
20:04:41  Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
20:04:41   > git init /w/workspace/ci-management-openstack-cron # timeout=10
20:04:41  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
20:04:41   > git --version # timeout=10
20:04:41   > git --version # 'git version 2.43.0'
20:04:41  using GIT_SSH to set credentials jenkins
20:04:41  [INFO] Currently running in a labeled security context
20:04:41  [INFO] Currently SELinux is 'enforcing' on the host
20:04:41   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh6964242001241996778.key
20:04:41   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
20:04:45   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
20:04:45   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
20:04:45  Avoid second fetch
20:04:45   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
20:04:45  Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master)
20:04:45   > git config core.sparsecheckout # timeout=10
20:04:45   > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
20:04:46  Commit message: "CI: Update github2gerrit caller to v2.4.4"
20:04:46   > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
20:04:46   > git remote # timeout=10
20:04:46   > git submodule init # timeout=10
20:04:46   > git submodule sync # timeout=10
20:04:46   > git config --get remote.origin.url # timeout=10
20:04:46   > git submodule init # timeout=10
20:04:46   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
20:04:46   > git config --get submodule.packer/common-packer.url # timeout=10
20:04:46   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
20:04:46   > git config --get submodule.global-jjb.url # timeout=10
20:04:46   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
20:04:46   > git submodule update --init --recursive packer/common-packer # timeout=10
20:04:50   > git submodule update --init --recursive global-jjb # timeout=10
20:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
20:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
20:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
20:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
20:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
20:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
20:05:01  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
20:05:01  provisioning config files...
20:05:01  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
20:05:01  copy managed file [npmrc] to file:/home/jenkins/.npmrc
20:05:01  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
20:05:01  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1899388216216426314.sh
20:05:01  ---> python-tools-install.sh
20:05:01  Setup pyenv:
20:05:01    system
20:05:01  * 3.8.13 (set by /opt/pyenv/version)
20:05:01  * 3.9.13 (set by /opt/pyenv/version)
20:05:01  * 3.10.6 (set by /opt/pyenv/version)
20:05:06  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Bra6
20:05:06  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
20:05:06  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
20:05:18  lf-activate-venv(): INFO: Installing additional packages: lftools 
20:05:53  lf-activate-venv(): INFO: Adding /tmp/venv-Bra6/bin to PATH
20:05:53  Generating Requirements File
20:06:36  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
20:06:36  botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
20:06:36  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
20:06:36  Python 3.10.6
20:06:37  pip 26.3 from /tmp/venv-Bra6/lib/python3.10/site-packages/pip (python 3.10)
20:06:37  aiohappyeyeballs==2.7.1
20:06:37  aiohttp==3.14.5
20:06:37  aiosignal==1.4.0
20:06:37  appdirs==1.4.4
20:06:37  argcomplete==3.7.2
20:06:37  aspy.yaml==1.3.0
20:06:37  async-timeout==5.0.1
20:06:37  attrs==26.1.0
20:06:37  autopage==0.6.0
20:06:37  backports.strenum==1.3.1
20:06:37  beautifulsoup4==4.15.0
20:06:37  boto3==1.43.126
20:06:37  botocore==1.43.126
20:06:37  bs4==0.0.2
20:06:37  certifi==2026.10.23
20:06:37  cffi==2.1.1
20:06:37  cfgv==3.5.0
20:06:37  chardet==7.7.0
20:06:37  charset-normalizer==3.5.2
20:06:37  click==8.5.1
20:06:37  cliff==4.14.0
20:06:37  cmd2==3.5.1
20:06:37  cryptography==3.3.2
20:06:37  debtcollector==3.1.0
20:06:37  decorator==5.3.1
20:06:37  defusedxml==0.7.1
20:06:37  Deprecated==1.3.1
20:06:37  distlib==0.4.4
20:06:37  dnspython==2.8.0
20:06:37  docker==7.2.0
20:06:37  dogpile.cache==1.5.0
20:06:37  durationpy==0.11
20:06:37  email-validator==2.3.0
20:06:37  filelock==4.1.0
20:06:37  frozenlist==1.8.0
20:06:37  future==1.0.0
20:06:37  gitdb==4.0.12
20:06:37  GitPython==3.2.1
20:06:37  httplib2==0.30.2
20:06:37  identify==2.6.20
20:06:37  idna==3.20
20:06:37  importlib-resources==1.5.0
20:06:37  iso8601==2.1.0
20:06:37  Jinja2==3.1.6
20:06:37  jmespath==1.1.0
20:06:37  jsonpatch==1.45
20:06:37  jsonpointer==3.10
20:06:37  jsonschema==4.26.0
20:06:37  jsonschema-specifications==2025.9.1
20:06:37  keystoneauth1==5.14.0
20:06:37  kubernetes==36.0.3
20:06:37  lftools==0.37.26
20:06:37  lxml==6.1.3
20:06:37  markdown-it-py==4.2.0
20:06:37  MarkupSafe==3.0.4
20:06:37  mdurl==0.1.2
20:06:37  msgpack==1.2.4
20:06:37  multi_key_dict==2.0.4
20:06:37  multidict==7.1.0
20:06:37  munch==4.0.0
20:06:37  netaddr==1.3.0
20:06:37  niet==1.4.2
20:06:37  nodeenv==1.12.0
20:06:37  oauth2client==4.1.3
20:06:37  oauthlib==4.0.1
20:06:37  openstacksdk==4.13.0
20:06:37  os-service-types==1.8.2
20:06:37  osc-lib==4.6.0
20:06:37  oslo.config==10.4.0
20:06:37  oslo.context==6.4.0
20:06:37  oslo.i18n==6.8.0
20:06:37  oslo.log==8.2.0
20:06:37  oslo.serialization==5.10.0
20:06:37  oslo.utils==10.1.1
20:06:37  packaging==26.3
20:06:37  pbr==7.1.3
20:06:37  platformdirs==4.12.4
20:06:37  prettytable==3.18.0
20:06:37  propcache==0.5.4
20:06:37  psutil==7.2.2
20:06:37  pyasn1==0.6.5
20:06:37  pyasn1_modules==0.4.2
20:06:37  pycparser==3.11
20:06:37  pygerrit2==2.0.15
20:06:37  PyGithub==2.10.0
20:06:37  Pygments==2.21.0
20:06:37  PyJWT==2.15.1
20:06:37  PyNaCl==1.6.2
20:06:37  pyparsing==2.4.7
20:06:37  pyperclip==1.11.0
20:06:37  pyrsistent==0.20.0
20:06:37  python-cinderclient==9.9.0
20:06:37  python-dateutil==3.0.0
20:06:37  python-discovery==1.9.5
20:06:37  python-heatclient==5.2.0
20:06:37  python-jenkins==1.8.3
20:06:37  python-keystoneclient==6.0.0
20:06:37  python-magnumclient==4.11.0
20:06:37  python-openstackclient==10.0.0
20:06:37  python-swiftclient==4.11.0
20:06:37  PyYAML==6.0.3
20:06:37  referencing==0.37.0
20:06:37  requests==2.34.2
20:06:37  requests-oauthlib==2.0.0
20:06:37  rfc3986==2.0.0
20:06:37  rich==15.0.0
20:06:37  rich-argparse==1.8.0
20:06:37  rpds-py==0.30.0
20:06:37  rsa==4.9.1
20:06:37  ruamel.yaml==0.19.1
20:06:37  ruamel.yaml.clib==0.2.15
20:06:37  s3transfer==0.19.3
20:06:37  simplejson==4.2.0
20:06:37  six==1.17.0
20:06:37  smmap==5.0.3
20:06:37  soupsieve==2.10
20:06:37  stevedore==5.8.0
20:06:37  tabulate==0.10.0
20:06:37  toml==0.10.2
20:06:37  tomlkit==0.15.2
20:06:37  tqdm==4.70.1
20:06:37  typing_extensions==4.16.0
20:06:37  tzdata==2026.6
20:06:37  urllib3==1.26.20
20:06:37  virtualenv==21.15.6
20:06:37  wcwidth==0.9.4
20:06:37  websocket-client==1.9.2
20:06:37  wrapt==2.5.2
20:06:37  xdg==6.0.0
20:06:37  xmltodict==1.0.4
20:06:37  yarl==1.25.1
20:06:37  yq==4.4.5
20:06:37  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins14187467480269882009.sh
20:06:37  ---> uv-install.sh
20:06:37  Installing uv/uvx (latest) using shell installer
20:06:44  2026-11-09 20:06:44 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-TPhl1Y.sh" [1]
20:06:44  downloading uv 0.13.7 x86_64-unknown-linux-gnu
20:06:48  installing to /home/jenkins/.local/bin
20:06:48    uv
20:06:48    uvx
20:06:48  everything's installed!
20:06:48  ---> Validating uv/uvx install
20:06:48  uvx 0.13.7 (x86_64-unknown-linux-gnu)
20:06:48  [EnvInject] - Injecting environment variables from a build step.
20:06:48  [EnvInject] - Injecting as environment variables the properties content 
20:06:48  OS_CLOUD=vex
20:06:48  
20:06:48  [EnvInject] - Variables injected successfully.
20:06:48  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
20:06:48  Run condition [Boolean condition] enabling perform for step [Execute shell]
20:06:48  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins16361160137559493370.sh
20:06:48  ---> Orphaned k8s clusters
20:06:48  Setup pyenv:
20:06:48    system
20:06:48    3.8.13
20:06:48    3.9.13
20:06:48  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
20:06:48  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Bra6 from file:/tmp/.os_lf_venv
20:06:48  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
20:06:53  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
20:07:19  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
20:07:19  botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
20:07:20  lf-activate-venv(): INFO: Adding /tmp/venv-Bra6/bin to PATH
20:07:31  -----> Delete orphaned cluster
20:07:31  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
20:07:31  Run condition [Boolean condition] enabling perform for step [Execute shell]
20:07:31  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins16624790220060844434.sh
20:07:31  ---> Orphaned stacks
20:07:31  Setup pyenv:
20:07:31    system
20:07:31    3.8.13
20:07:31    3.9.13
20:07:31  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
20:07:31  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Bra6 from file:/tmp/.os_lf_venv
20:07:31  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
20:07:36  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
20:08:08  lf-activate-venv(): INFO: Adding /tmp/venv-Bra6/bin to PATH
20:08:08  + mapfile -t OS_COE_CLUSTERS_ID
20:08:08  ++ awk '{print $1}'
20:08:08  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
20:08:08  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
20:08:18  + echo '-----> Active clusters -> stacks'
20:08:18  -----> Active clusters -> stacks
20:08:18  + OS_COE_STACKS=()
20:08:18  + [[ 0 -gt 0 ]]
20:08:18  + mapfile -t OS_STACKS
20:08:18  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
20:08:18  ++ awk '{print $1}'
20:08:26  + echo '-----> Active stacks'
20:08:26  -----> Active stacks
20:08:26  + echo '-----> Delete orphaned stacks'
20:08:26  -----> Delete orphaned stacks
20:08:26  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
20:08:26  Run condition [Boolean condition] enabling perform for step [Execute shell]
20:08:26  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins6150406948911730179.sh
20:08:26  ---> Orphaned servers
20:08:26  Setup pyenv:
20:08:26    system
20:08:26    3.8.13
20:08:26    3.9.13
20:08:26  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
20:08:27  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Bra6 from file:/tmp/.os_lf_venv
20:08:27  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
20:08:32  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
20:11:17  ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device
20:11:17  
20:11:19  lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple
20:15:01  Build timed out (after 10 minutes). Marking the build as failed.
20:15:01  $ ssh-agent -k
20:15:01  unset SSH_AUTH_SOCK;
20:15:01  unset SSH_AGENT_PID;
20:15:01  echo Agent pid 5170 killed;
20:15:01  [ssh-agent] Stopped.
20:15:01  Build was aborted
20:15:01  [PostBuildScript] - [INFO] Executing post build scripts.
20:15:01  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6773228615203819641.sh
20:15:01  ---> sysstat.sh
20:15:01  /home/jenkins/lf-env.sh: line 73:  6648 Terminated              "$venv_python" -m pip install --index-url "$upstream" "$@"
20:15:01  lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
20:15:01  /tmp/jenkins6150406948911730179.sh: line 67: openstack: command not found
20:15:01  -----> Active servers
20:15:01  -----> Delete orphaned servers
20:15:02  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins8710810252147997129.sh
20:15:02  ---> package-listing.sh
20:15:02  ++ facter osfamily
20:15:02  ++ tr '[:upper:]' '[:lower:]'
20:15:03  + OS_FAMILY=redhat
20:15:03  + workspace=/w/workspace/ci-management-openstack-cron
20:15:03  + START_PACKAGES=/tmp/packages_start.txt
20:15:03  + END_PACKAGES=/tmp/packages_end.txt
20:15:03  + DIFF_PACKAGES=/tmp/packages_diff.txt
20:15:03  + PACKAGES=/tmp/packages_start.txt
20:15:03  + '[' /w/workspace/ci-management-openstack-cron ']'
20:15:03  + PACKAGES=/tmp/packages_end.txt
20:15:03  + case "${OS_FAMILY}" in
20:15:03  + rpm -qa
20:15:03  + sort
20:15:10  + '[' -f /tmp/packages_start.txt ']'
20:15:10  + '[' -f /tmp/packages_end.txt ']'
20:15:10  + diff /tmp/packages_start.txt /tmp/packages_end.txt
20:15:10  + '[' /w/workspace/ci-management-openstack-cron ']'
20:15:10  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
20:15:10  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
20:15:10  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13601805734875822047.sh
20:15:10  ---> capture-instance-metadata.sh
20:15:10  Setup pyenv:
20:15:10    system
20:15:10    3.8.13
20:15:10    3.9.13
20:15:10  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
20:15:10  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Bra6 from file:/tmp/.os_lf_venv
20:15:10  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
20:15:15  lf-activate-venv(): INFO: Installing additional packages: lftools 
20:15:31  lf-activate-venv(): INFO: Adding /tmp/venv-Bra6/bin to PATH
20:15:31  INFO: Running in OpenStack, capturing instance metadata
20:15:31  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4167217942111526635.sh
20:15:31  provisioning config files...
20:15:31  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config5718161755557582789tmp
20:15:31  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
20:15:31  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
20:15:31  [EnvInject] - Injecting environment variables from a build step.
20:15:31  [EnvInject] - Injecting as environment variables the properties content 
20:15:31  SERVER_ID=logs
20:15:31  
20:15:31  [EnvInject] - Variables injected successfully.
20:15:31  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins17227501015098280375.sh
20:15:31  ---> create-netrc.sh
20:15:31  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3736799657865199721.sh
20:15:31  ---> python-tools-install.sh
20:15:31  Setup pyenv:
20:15:31    system
20:15:31    3.8.13
20:15:31    3.9.13
20:15:32  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
20:15:32  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Bra6 from file:/tmp/.os_lf_venv
20:15:32  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
20:15:37  lf-activate-venv(): INFO: Installing additional packages: lftools 
20:15:52  lf-activate-venv(): INFO: Adding /tmp/venv-Bra6/bin to PATH
20:15:52  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins14880609650363624038.sh
20:15:52  ---> uv-install.sh
20:15:52  uv 0.13.7 is already installed
20:15:52  uvx 0.13.7 (x86_64-unknown-linux-gnu)
20:15:52  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10376735937240451560.sh
20:15:52  ---> sudo-logs.sh
20:15:52  Archiving 'sudo' log..
20:15:53  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3554571986569373926.sh
20:15:53  ---> job-cost.sh
20:15:53  INFO: Activating Python virtual environment...
20:15:53  Setup pyenv:
20:15:53    system
20:15:53    3.8.13
20:15:53    3.9.13
20:15:53  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
20:15:53  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Bra6 from file:/tmp/.os_lf_venv
20:15:53  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
20:15:58  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
20:16:11  lf-activate-venv(): INFO: Adding /tmp/venv-Bra6/bin to PATH
20:16:11  INFO: No stack-cost file found
20:16:11  INFO: Instance uptime: 752s
20:16:11  INFO: Fetching instance metadata (attempt 1 of 3)...
20:16:11  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
20:16:11  INFO: Successfully fetched instance metadata
20:16:11  INFO: Instance type: v3-starter-2
20:16:11  INFO: Retrieving pricing info for: v3-starter-2
20:16:11  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
20:16:11  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=752
20:16:13  INFO: Successfully fetched Vexxhost pricing API
20:16:13  INFO: Retrieved cost: 0.02
20:16:13  INFO: Retrieved resource: v3-starter-2
20:16:13  INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost
20:16:13  INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv
20:16:13  INFO: Successfully archived job cost data
20:16:13  DEBUG: Cost data: ci-management-openstack-cron,63729,2026-11-09 20:16:13,v3-starter-2,752,0.02,0.00,FAILURE
20:16:13  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins12747223451153796442.sh
20:16:13  ---> logs-deploy.sh
20:16:13  Setup pyenv:
20:16:13    system
20:16:13    3.8.13
20:16:13    3.9.13
20:16:13  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
20:16:13  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Bra6 from file:/tmp/.os_lf_venv
20:16:13  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
20:16:18  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
20:16:31  lf-activate-venv(): INFO: Adding /tmp/venv-Bra6/bin to PATH
20:16:31  INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63729
20:16:31  INFO: archiving workspace using pattern(s): 
20:16:35  Archives upload complete.
20:16:35  INFO: archiving logs to Nexus
20:16:36  ---> uname -a:
20:16:36  Linux prd-centos8-builder-2c-4g-2324.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
20:16:36  
20:16:36  
20:16:36  ---> lscpu:
20:16:36  Architecture:        x86_64
20:16:36  CPU op-mode(s):      32-bit, 64-bit
20:16:36  Byte Order:          Little Endian
20:16:36  CPU(s):              2
20:16:36  On-line CPU(s) list: 0,1
20:16:36  Thread(s) per core:  1
20:16:36  Core(s) per socket:  1
20:16:36  Socket(s):           2
20:16:36  NUMA node(s):        1
20:16:36  Vendor ID:           AuthenticAMD
20:16:36  CPU family:          23
20:16:36  Model:               49
20:16:36  Model name:          AMD EPYC-Rome Processor
20:16:36  Stepping:            0
20:16:36  CPU MHz:             2799.998
20:16:36  BogoMIPS:            5599.99
20:16:36  Virtualization:      AMD-V
20:16:36  Hypervisor vendor:   KVM
20:16:36  Virtualization type: full
20:16:36  L1d cache:           32K
20:16:36  L1i cache:           32K
20:16:36  L2 cache:            512K
20:16:36  L3 cache:            16384K
20:16:36  NUMA node0 CPU(s):   0,1
20:16:36  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
20:16:36  
20:16:36  
20:16:36  ---> nproc:
20:16:36  2
20:16:36  
20:16:36  
20:16:36  ---> df -h:
20:16:36  Filesystem      Size  Used Avail Use% Mounted on
20:16:36  devtmpfs        1.8G     0  1.8G   0% /dev
20:16:36  tmpfs           1.8G     0  1.8G   0% /dev/shm
20:16:36  tmpfs           1.8G   17M  1.8G   1% /run
20:16:36  tmpfs           1.8G     0  1.8G   0% /sys/fs/cgroup
20:16:36  /dev/vda1        20G   15G  5.4G  74% /
20:16:36  tmpfs           367M     0  367M   0% /run/user/1001
20:16:36  
20:16:36  
20:16:36  ---> free -m:
20:16:36                total        used        free      shared  buff/cache   available
20:16:36  Mem:           3665         468        1224          17        1972        2895
20:16:36  Swap:          1023           1        1022
20:16:36  
20:16:36  
20:16:36  ---> ip addr:
20:16:36  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
20:16:36      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
20:16:36      inet 127.0.0.1/8 scope host lo
20:16:36         valid_lft forever preferred_lft forever
20:16:36      inet6 ::1/128 scope host 
20:16:36         valid_lft forever preferred_lft forever
20:16:36  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
20:16:36      link/ether fa:16:3e:7b:75:4b brd ff:ff:ff:ff:ff:ff
20:16:36      altname enp0s3
20:16:36      altname ens3
20:16:36      inet 10.32.6.132/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
20:16:36         valid_lft 85655sec preferred_lft 85655sec
20:16:36      inet6 fe80::f816:3eff:fe7b:754b/64 scope link 
20:16:36         valid_lft forever preferred_lft forever
20:16:36  
20:16:36  
20:16:36  ---> sar -b -r -n DEV:
20:16:36  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/09/2026 	_x86_64_	(2 CPU)
20:16:36  
20:16:36  20:03:46     LINUX RESTART	(2 CPU)
20:16:36  
20:16:36  08:05:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
20:16:36  08:06:01 PM     54.73      6.11     48.62    926.22   5319.44
20:16:36  08:07:01 PM     65.29      0.70     64.59    201.57   9549.64
20:16:36  08:08:01 PM     42.82      0.50     42.32     60.65  11823.49
20:16:36  08:09:01 PM     40.56      0.05     40.51      1.33  20140.68
20:16:36  08:10:02 PM    107.77      1.33    106.44    253.44 153844.96
20:16:36  08:11:01 PM    128.19     11.01    117.18    909.10 161858.48
20:16:36  08:12:01 PM     75.23      3.96     71.26    473.50  52410.06
20:16:36  08:13:01 PM     86.64      0.35     86.29     71.98   2208.46
20:16:36  08:14:01 PM     73.54      0.03     73.50      1.07   1991.05
20:16:36  08:15:01 PM     80.39      0.07     80.32      2.13   2120.48
20:16:36  08:16:01 PM    113.31     91.44     21.88   8163.15    687.52
20:16:36  Average:        78.88     10.50     68.38   1005.93  38190.07
20:16:36  
20:16:36  08:05:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
20:16:36  08:06:01 PM   1364264   3021052   2389412     63.66      2104   1825824    602876     12.55    137304   1963532    145368
20:16:36  08:07:01 PM   1063628   2972252   2690048     71.66      2104   2068164    619432     12.90    138112   2227876    153688
20:16:36  08:08:01 PM    808152   2876868   2945524     78.47      2104   2226816    711616     14.82    155604   2458024     77724
20:16:36  08:09:01 PM    170052   2867012   3583624     95.47      2104   2854464    723236     15.06    185324   3064808    249412
20:16:36  08:10:02 PM    134136   2821644   3619540     96.43      2104   2841220    768220     16.00    236492   3048144    144040
20:16:36  08:11:01 PM    107676   2802108   3646000     97.13      2104   2841804    826048     17.20    283472   3067460    278968
20:16:36  08:12:01 PM   1569552   2915608   2184124     58.19      2104   1496892    714612     14.88    182012   1708252      2304
20:16:36  08:13:01 PM   1506332   2879356   2247344     59.87      2104   1518964    737564     15.36    190112   1748248      4100
20:16:36  08:14:01 PM   1440784   2833768   2312892     61.62      2104   1535064    775880     16.16    196552   1794876      3716
20:16:36  08:15:01 PM   1370852   2785716   2382824     63.48      2104   1552776    813428     16.94    203628   1843472      3724
20:16:36  08:16:01 PM   1339368   3006440   2414308     64.32      2104   1803740    583460     12.15    219496   1852672      7404
20:16:36  Average:       988618   2889257   2765058     73.66      2104   2051430    716034     14.91    193464   2252488     97313
20:16:36  
20:16:36  08:05:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
20:16:36  08:06:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:06:01 PM      eth0     50.85     41.65    890.57      4.75      0.00      0.00      0.00      0.00
20:16:36  08:07:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:07:01 PM      eth0     67.44     57.57   1020.77      7.14      0.00      0.00      0.00      0.00
20:16:36  08:08:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:08:01 PM      eth0     44.22     38.57    737.31      8.52      0.00      0.00      0.00      0.00
20:16:36  08:09:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:09:01 PM      eth0    241.09    188.44   5591.27     15.40      0.00      0.00      0.00      0.00
20:16:36  08:10:02 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:10:02 PM      eth0   1897.74   1377.22  37775.69     93.68      0.00      0.00      0.00      0.00
20:16:36  08:11:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:11:01 PM      eth0   2108.67   1527.17  41650.10    112.49      0.00      0.00      0.00      0.00
20:16:36  08:12:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:12:01 PM      eth0    619.84    410.04  10783.75     32.25      0.00      0.00      0.00      0.00
20:16:36  08:13:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:13:01 PM      eth0     50.68     36.64    124.66     12.92      0.00      0.00      0.00      0.00
20:16:36  08:14:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:14:01 PM      eth0     39.46     29.50    102.11     10.41      0.00      0.00      0.00      0.00
20:16:36  08:15:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:15:01 PM      eth0     43.74     32.49    106.65     11.51      0.00      0.00      0.00      0.00
20:16:36  08:16:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  08:16:01 PM      eth0     14.61     12.88     11.22      6.60      0.00      0.00      0.00      0.00
20:16:36  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
20:16:36  Average:         eth0    468.50    339.47   8936.19     28.58      0.00      0.00      0.00      0.00
20:16:36  
20:16:36  
20:16:36  ---> sar -P ALL:
20:16:36  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/09/2026 	_x86_64_	(2 CPU)
20:16:36  
20:16:36  20:03:46     LINUX RESTART	(2 CPU)
20:16:36  
20:16:36  08:05:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
20:16:36  08:06:01 PM     all     23.99      0.00      3.22      1.58      0.08     71.13
20:16:36  08:06:01 PM       0     22.79      0.00      2.66      0.77      0.08     73.71
20:16:36  08:06:01 PM       1     25.18      0.00      3.79      2.39      0.08     68.56
20:16:36  08:07:01 PM     all     23.54      0.00      3.34      2.62      0.08     70.42
20:16:36  08:07:01 PM       0      9.13      0.00      2.17      2.45      0.05     86.20
20:16:36  08:07:01 PM       1     37.96      0.00      4.51      2.79      0.10     54.64
20:16:36  08:08:01 PM     all     29.25      0.00      2.82      1.15      0.09     66.69
20:16:36  08:08:01 PM       0      9.48      0.00      1.89      1.35      0.08     87.20
20:16:36  08:08:01 PM       1     49.02      0.00      3.75      0.95      0.10     46.17
20:16:36  08:09:01 PM     all     23.57      0.00      3.46      1.08      0.08     71.81
20:16:36  08:09:01 PM       0     17.29      0.00      2.63      1.27      0.08     78.73
20:16:36  08:09:01 PM       1     29.84      0.00      4.29      0.89      0.07     64.91
20:16:36  08:10:02 PM     all     23.74      0.00     12.04      3.04      0.11     61.07
20:16:36  08:10:02 PM       0     19.04      0.00     12.36      3.41      0.10     65.09
20:16:36  08:10:02 PM       1     28.37      0.00     11.73      2.69      0.12     57.10
20:16:36  08:11:01 PM     all     22.00      0.00     13.05      2.75      0.11     62.09
20:16:36  08:11:01 PM       0     24.24      0.00     14.57      2.24      0.12     58.83
20:16:36  08:11:01 PM       1     19.79      0.00     11.56      3.25      0.10     65.29
20:16:36  08:12:01 PM     all     31.56      0.00      5.18      1.17      0.11     61.99
20:16:36  08:12:01 PM       0     23.33      0.00      5.80      1.31      0.10     69.46
20:16:36  08:12:01 PM       1     39.75      0.00      4.57      1.02      0.12     54.54
20:16:36  08:13:01 PM     all     39.54      0.00      1.70      0.63      0.12     58.01
20:16:36  08:13:01 PM       0     22.21      0.00      1.42      0.47      0.10     75.80
20:16:36  08:13:01 PM       1     56.87      0.00      1.99      0.78      0.13     40.23
20:16:36  08:14:01 PM     all     41.13      0.00      1.32      0.49      0.12     56.94
20:16:36  08:14:01 PM       0     11.87      0.00      0.95      0.07      0.08     87.03
20:16:36  08:14:01 PM       1     70.35      0.00      1.69      0.92      0.15     26.89
20:16:36  08:15:01 PM     all     40.11      0.00      1.44      0.52      0.10     57.83
20:16:36  08:15:01 PM       0     14.19      0.00      1.02      0.23      0.07     84.49
20:16:36  08:15:01 PM       1     66.00      0.00      1.85      0.80      0.13     31.21
20:16:36  08:16:01 PM     all     23.03      0.00      2.83      6.34      0.08     67.73
20:16:36  08:16:01 PM       0     19.34      0.00      2.76      1.71      0.07     76.13
20:16:36  08:16:01 PM       1     26.71      0.00      2.91     10.96      0.08     59.33
20:16:36  
20:16:36  Average:        CPU     %user     %nice   %system   %iowait    %steal     %idle
20:16:36  Average:        all     29.25      0.00      4.55      1.94      0.10     64.17
20:16:36  Average:          0     17.51      0.00      4.33      1.38      0.09     76.69
20:16:36  Average:          1     40.95      0.00      4.77      2.49      0.11     51.68
20:16:36  
20:16:36  
20:16:36