22:04:41  Started by timer
22:04:41  Running as SYSTEM
22:04:41  [EnvInject] - Loading node environment variables.
22:04:41  Building remotely on prd-centos8-builder-2c-4g-2562 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
22:04:41  [ssh-agent] Looking for ssh-agent implementation...
22:04:41  $ ssh-agent
22:04:41  SSH_AUTH_SOCK=/tmp/ssh-w7Ha6ZRif2Il/agent.5172
22:04:41  SSH_AGENT_PID=5174
22:04:41  [ssh-agent] Started.
22:04:41  Running ssh-add (command line suppressed)
22:04:41  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_4079058884844696830.key (jenkins-ssh)
22:04:41  [ssh-agent] Using credentials jenkins (jenkins)
22:04:41  The recommended git tool is: NONE
22:04:43  using credential jenkins
22:04:43  Wiping out workspace first.
22:04:43  Cloning the remote Git repository
22:04:43  Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
22:04:43   > git init /w/workspace/ci-management-openstack-cron # timeout=10
22:04:43  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
22:04:43   > git --version # timeout=10
22:04:43   > git --version # 'git version 2.43.0'
22:04:43  using GIT_SSH to set credentials jenkins
22:04:43  [INFO] Currently running in a labeled security context
22:04:43  [INFO] Currently SELinux is 'enforcing' on the host
22:04:43   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh17185293009683976286.key
22:04:43   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
22:04:47   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
22:04:47   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
22:04:48  Avoid second fetch
22:04:48   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
22:04:48  Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master)
22:04:48   > git config core.sparsecheckout # timeout=10
22:04:48   > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
22:04:48  Commit message: "CI: Update github2gerrit caller to v2.4.4"
22:04:48   > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
22:04:48   > git remote # timeout=10
22:04:48   > git submodule init # timeout=10
22:04:48   > git submodule sync # timeout=10
22:04:48   > git config --get remote.origin.url # timeout=10
22:04:48   > git submodule init # timeout=10
22:04:48   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
22:04:48   > git config --get submodule.packer/common-packer.url # timeout=10
22:04:49   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
22:04:49   > git config --get submodule.global-jjb.url # timeout=10
22:04:49   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
22:04:49   > git submodule update --init --recursive packer/common-packer # timeout=10
22:04:53   > git submodule update --init --recursive global-jjb # timeout=10
22:05:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:03  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
22:05:03  provisioning config files...
22:05:03  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
22:05:03  copy managed file [npmrc] to file:/home/jenkins/.npmrc
22:05:03  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
22:05:03  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2778094596641596446.sh
22:05:03  ---> python-tools-install.sh
22:05:03  Setup pyenv:
22:05:03    system
22:05:03  * 3.8.13 (set by /opt/pyenv/version)
22:05:03  * 3.9.13 (set by /opt/pyenv/version)
22:05:03  * 3.10.6 (set by /opt/pyenv/version)
22:05:08  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-r0au
22:05:08  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
22:05:08  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:05:20  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:05:56  lf-activate-venv(): INFO: Adding /tmp/venv-r0au/bin to PATH
22:05:56  Generating Requirements File
22:06:39  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:06:39  botocore 1.44.1 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
22:06:39  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
22:06:40  Python 3.10.6
22:06:40  pip 26.3 from /tmp/venv-r0au/lib/python3.10/site-packages/pip (python 3.10)
22:06:41  aiohappyeyeballs==2.7.1
22:06:41  aiohttp==3.14.5
22:06:41  aiosignal==1.4.0
22:06:41  appdirs==1.4.4
22:06:41  argcomplete==3.7.2
22:06:41  aspy.yaml==1.3.0
22:06:41  async-timeout==5.0.1
22:06:41  attrs==26.1.0
22:06:41  autopage==0.6.0
22:06:41  backports.strenum==1.3.1
22:06:41  beautifulsoup4==4.15.0
22:06:41  boto3==1.44.1
22:06:41  botocore==1.44.1
22:06:41  bs4==0.0.2
22:06:41  certifi==2026.10.23
22:06:41  cffi==2.1.1
22:06:41  cfgv==3.5.0
22:06:41  chardet==7.7.0
22:06:41  charset-normalizer==3.5.2
22:06:41  click==8.5.1
22:06:41  cliff==4.14.0
22:06:41  cmd2==3.5.1
22:06:41  cryptography==3.3.2
22:06:41  debtcollector==3.1.0
22:06:41  decorator==5.3.1
22:06:41  defusedxml==0.7.1
22:06:41  Deprecated==1.3.1
22:06:41  distlib==0.4.4
22:06:41  dnspython==2.8.0
22:06:41  docker==7.2.0
22:06:41  dogpile.cache==1.5.0
22:06:41  durationpy==0.11
22:06:41  email-validator==2.3.0
22:06:41  filelock==4.1.0
22:06:41  frozenlist==1.8.0
22:06:41  future==1.0.0
22:06:41  gitdb==4.0.12
22:06:41  GitPython==3.2.1
22:06:41  httplib2==0.30.2
22:06:41  identify==2.6.20
22:06:41  idna==3.20
22:06:41  importlib-resources==1.5.0
22:06:41  iso8601==2.1.0
22:06:41  Jinja2==3.1.6
22:06:41  jmespath==1.1.0
22:06:41  jsonpatch==1.46
22:06:41  jsonpointer==3.12
22:06:41  jsonschema==4.26.0
22:06:41  jsonschema-specifications==2025.9.1
22:06:41  keystoneauth1==5.14.0
22:06:41  kubernetes==36.0.3
22:06:41  lftools==0.37.26
22:06:41  lxml==6.1.3
22:06:41  markdown-it-py==4.3.0
22:06:41  MarkupSafe==3.0.4
22:06:41  mdurl==0.1.2
22:06:41  msgpack==1.2.4
22:06:41  multi_key_dict==2.0.4
22:06:41  multidict==7.1.0
22:06:41  munch==4.0.0
22:06:41  netaddr==1.3.0
22:06:41  niet==1.4.2
22:06:41  nodeenv==1.12.0
22:06:41  oauth2client==4.1.3
22:06:41  oauthlib==4.0.1
22:06:41  openstacksdk==4.13.0
22:06:41  os-service-types==1.8.2
22:06:41  osc-lib==4.6.0
22:06:41  oslo.config==10.4.0
22:06:41  oslo.context==6.4.0
22:06:41  oslo.i18n==6.8.0
22:06:41  oslo.log==8.2.0
22:06:41  oslo.serialization==5.10.0
22:06:41  oslo.utils==10.1.1
22:06:41  packaging==26.3
22:06:41  pbr==7.1.3
22:06:41  platformdirs==4.12.4
22:06:41  prettytable==3.18.0
22:06:41  propcache==0.5.4
22:06:41  psutil==7.2.2
22:06:41  pyasn1==0.6.5
22:06:41  pyasn1_modules==0.4.2
22:06:41  pycparser==3.11
22:06:41  pygerrit2==2.0.15
22:06:41  PyGithub==2.10.0
22:06:41  Pygments==2.21.0
22:06:41  PyJWT==2.15.1
22:06:41  PyNaCl==1.6.2
22:06:41  pyparsing==2.4.7
22:06:41  pyperclip==1.11.0
22:06:41  pyrsistent==0.20.0
22:06:41  python-cinderclient==9.9.0
22:06:41  python-dateutil==3.0.0
22:06:41  python-discovery==1.9.5
22:06:41  python-heatclient==5.2.0
22:06:41  python-jenkins==1.8.3
22:06:41  python-keystoneclient==6.0.0
22:06:41  python-magnumclient==4.11.0
22:06:41  python-openstackclient==10.0.0
22:06:41  python-swiftclient==4.11.0
22:06:41  PyYAML==6.0.3
22:06:41  referencing==0.37.0
22:06:41  requests==2.34.2
22:06:41  requests-oauthlib==2.0.0
22:06:41  rfc3986==2.0.0
22:06:41  rich==15.0.0
22:06:41  rich-argparse==1.8.0
22:06:41  rpds-py==0.30.0
22:06:41  rsa==4.9.1
22:06:41  ruamel.yaml==0.19.1
22:06:41  ruamel.yaml.clib==0.2.15
22:06:41  s3transfer==0.19.3
22:06:41  simplejson==4.3.0
22:06:41  six==1.17.0
22:06:41  smmap==5.0.3
22:06:41  soupsieve==2.10
22:06:41  stevedore==5.8.0
22:06:41  tabulate==0.10.0
22:06:41  toml==0.10.2
22:06:41  tomlkit==0.15.2
22:06:41  tqdm==4.70.1
22:06:41  typing_extensions==4.16.0
22:06:41  tzdata==2026.6
22:06:41  urllib3==1.26.20
22:06:41  virtualenv==21.15.6
22:06:41  wcwidth==0.9.4
22:06:41  websocket-client==1.9.2
22:06:41  wrapt==2.5.2
22:06:41  xdg==6.0.0
22:06:41  xmltodict==1.0.4
22:06:41  yarl==1.25.1
22:06:41  yq==4.4.5
22:06:41  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins2166296636723578550.sh
22:06:41  ---> uv-install.sh
22:06:41  Installing uv/uvx (latest) using shell installer
22:06:47  2026-11-12 22:06:47 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-ItMXZt.sh" [1]
22:06:47  downloading uv 0.13.8 x86_64-unknown-linux-gnu
22:06:51  installing to /home/jenkins/.local/bin
22:06:51    uv
22:06:51    uvx
22:06:51  everything's installed!
22:06:51  ---> Validating uv/uvx install
22:06:51  uvx 0.13.8 (x86_64-unknown-linux-gnu)
22:06:51  [EnvInject] - Injecting environment variables from a build step.
22:06:51  [EnvInject] - Injecting as environment variables the properties content 
22:06:51  OS_CLOUD=vex
22:06:51  
22:06:51  [EnvInject] - Variables injected successfully.
22:06:51  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:06:51  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:06:51  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins4211180084994324499.sh
22:06:51  ---> Orphaned k8s clusters
22:06:51  Setup pyenv:
22:06:51    system
22:06:51    3.8.13
22:06:51    3.9.13
22:06:51  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:06:52  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r0au from file:/tmp/.os_lf_venv
22:06:52  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:06:57  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
22:07:23  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:07:23  botocore 1.44.1 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
22:07:24  lf-activate-venv(): INFO: Adding /tmp/venv-r0au/bin to PATH
22:07:35  -----> Delete orphaned cluster
22:07:35  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:07:35  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:07:35  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins5049516006327908340.sh
22:07:35  ---> Orphaned stacks
22:07:35  Setup pyenv:
22:07:35    system
22:07:35    3.8.13
22:07:35    3.9.13
22:07:35  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:07:35  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r0au from file:/tmp/.os_lf_venv
22:07:35  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:07:40  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
22:08:13  lf-activate-venv(): INFO: Adding /tmp/venv-r0au/bin to PATH
22:08:13  + mapfile -t OS_COE_CLUSTERS_ID
22:08:13  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
22:08:13  ++ awk '{print $1}'
22:08:13  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
22:08:23  + echo '-----> Active clusters -> stacks'
22:08:23  -----> Active clusters -> stacks
22:08:23  + OS_COE_STACKS=()
22:08:23  + [[ 0 -gt 0 ]]
22:08:23  + mapfile -t OS_STACKS
22:08:23  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
22:08:23  ++ awk '{print $1}'
22:08:32  + echo '-----> Active stacks'
22:08:32  -----> Active stacks
22:08:32  + echo '-----> Delete orphaned stacks'
22:08:32  -----> Delete orphaned stacks
22:08:32  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:08:32  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:08:32  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins17890269993634426796.sh
22:08:32  ---> Orphaned servers
22:08:32  Setup pyenv:
22:08:32    system
22:08:32    3.8.13
22:08:32    3.9.13
22:08:32  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:08:32  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r0au from file:/tmp/.os_lf_venv
22:08:32  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:08:37  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:11:12  ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device
22:11:12  
22:11:14  lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple
22:15:03  Build timed out (after 10 minutes). Marking the build as failed.
22:15:03  $ ssh-agent -k
22:15:03  unset SSH_AUTH_SOCK;
22:15:03  unset SSH_AGENT_PID;
22:15:03  echo Agent pid 5174 killed;
22:15:03  [ssh-agent] Stopped.
22:15:03  Build was aborted
22:15:03  [PostBuildScript] - [INFO] Executing post build scripts.
22:15:03  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins448056955310565254.sh
22:15:03  ---> sysstat.sh
22:15:03  /home/jenkins/lf-env.sh: line 73:  6638 Terminated              "$venv_python" -m pip install --index-url "$upstream" "$@"
22:15:03  lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:15:03  /tmp/jenkins17890269993634426796.sh: line 67: openstack: command not found
22:15:03  -----> Active servers
22:15:03  -----> Delete orphaned servers
22:15:05  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14901625325589114923.sh
22:15:05  ---> package-listing.sh
22:15:05  ++ facter osfamily
22:15:05  ++ tr '[:upper:]' '[:lower:]'
22:15:05  + OS_FAMILY=redhat
22:15:05  + workspace=/w/workspace/ci-management-openstack-cron
22:15:05  + START_PACKAGES=/tmp/packages_start.txt
22:15:05  + END_PACKAGES=/tmp/packages_end.txt
22:15:05  + DIFF_PACKAGES=/tmp/packages_diff.txt
22:15:05  + PACKAGES=/tmp/packages_start.txt
22:15:05  + '[' /w/workspace/ci-management-openstack-cron ']'
22:15:05  + PACKAGES=/tmp/packages_end.txt
22:15:05  + case "${OS_FAMILY}" in
22:15:05  + sort
22:15:05  + rpm -qa
22:15:12  + '[' -f /tmp/packages_start.txt ']'
22:15:12  + '[' -f /tmp/packages_end.txt ']'
22:15:12  + diff /tmp/packages_start.txt /tmp/packages_end.txt
22:15:12  + '[' /w/workspace/ci-management-openstack-cron ']'
22:15:12  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
22:15:12  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
22:15:12  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11219064131074966658.sh
22:15:12  ---> capture-instance-metadata.sh
22:15:12  Setup pyenv:
22:15:12    system
22:15:12    3.8.13
22:15:12    3.9.13
22:15:12  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:15:13  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r0au from file:/tmp/.os_lf_venv
22:15:13  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:15:16  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:15:31  lf-activate-venv(): INFO: Adding /tmp/venv-r0au/bin to PATH
22:15:31  INFO: Running in OpenStack, capturing instance metadata
22:15:32  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11871621632170510064.sh
22:15:32  provisioning config files...
22:15:32  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config2939044175785622939tmp
22:15:32  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
22:15:32  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
22:15:32  [EnvInject] - Injecting environment variables from a build step.
22:15:32  [EnvInject] - Injecting as environment variables the properties content 
22:15:32  SERVER_ID=logs
22:15:32  
22:15:32  [EnvInject] - Variables injected successfully.
22:15:32  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3818020524452174904.sh
22:15:32  ---> create-netrc.sh
22:15:32  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins17821651564909587644.sh
22:15:32  ---> python-tools-install.sh
22:15:32  Setup pyenv:
22:15:32    system
22:15:32    3.8.13
22:15:32    3.9.13
22:15:32  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:15:33  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r0au from file:/tmp/.os_lf_venv
22:15:33  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:15:36  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:15:49  lf-activate-venv(): INFO: Adding /tmp/venv-r0au/bin to PATH
22:15:49  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins6488285667450311356.sh
22:15:49  ---> uv-install.sh
22:15:49  uv 0.13.8 is already installed
22:15:49  uvx 0.13.8 (x86_64-unknown-linux-gnu)
22:15:49  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins15498661296918144822.sh
22:15:49  ---> sudo-logs.sh
22:15:49  Archiving 'sudo' log..
22:15:50  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10780202228677062182.sh
22:15:50  ---> job-cost.sh
22:15:50  INFO: Activating Python virtual environment...
22:15:50  Setup pyenv:
22:15:50    system
22:15:50    3.8.13
22:15:50    3.9.13
22:15:50  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:15:50  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r0au from file:/tmp/.os_lf_venv
22:15:50  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:15:55  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
22:16:05  lf-activate-venv(): INFO: Adding /tmp/venv-r0au/bin to PATH
22:16:05  INFO: No stack-cost file found
22:16:05  INFO: Instance uptime: 744s
22:16:05  INFO: Fetching instance metadata (attempt 1 of 3)...
22:16:05  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
22:16:05  INFO: Successfully fetched instance metadata
22:16:05  INFO: Instance type: v3-starter-2
22:16:05  INFO: Retrieving pricing info for: v3-starter-2
22:16:05  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
22:16:05  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=744
22:16:06  INFO: Successfully fetched Vexxhost pricing API
22:16:06  INFO: Retrieved cost: 0.02
22:16:06  INFO: Retrieved resource: v3-starter-2
22:16:06  INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost
22:16:06  INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv
22:16:06  INFO: Successfully archived job cost data
22:16:06  DEBUG: Cost data: ci-management-openstack-cron,63803,2026-11-12 22:16:06,v3-starter-2,744,0.02,0.00,FAILURE
22:16:06  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins13203728995715405829.sh
22:16:06  ---> logs-deploy.sh
22:16:06  Setup pyenv:
22:16:06    system
22:16:06    3.8.13
22:16:06    3.9.13
22:16:06  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:16:06  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r0au from file:/tmp/.os_lf_venv
22:16:06  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:16:10  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
22:16:24  lf-activate-venv(): INFO: Adding /tmp/venv-r0au/bin to PATH
22:16:24  INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63803
22:16:24  INFO: archiving workspace using pattern(s): 
22:16:28  Archives upload complete.
22:16:28  INFO: archiving logs to Nexus
22:16:29  ---> uname -a:
22:16:29  Linux prd-centos8-builder-2c-4g-2562.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
22:16:29  
22:16:29  
22:16:29  ---> lscpu:
22:16:29  Architecture:        x86_64
22:16:29  CPU op-mode(s):      32-bit, 64-bit
22:16:29  Byte Order:          Little Endian
22:16:29  CPU(s):              2
22:16:29  On-line CPU(s) list: 0,1
22:16:29  Thread(s) per core:  1
22:16:29  Core(s) per socket:  1
22:16:29  Socket(s):           2
22:16:29  NUMA node(s):        1
22:16:29  Vendor ID:           AuthenticAMD
22:16:29  CPU family:          23
22:16:29  Model:               49
22:16:29  Model name:          AMD EPYC-Rome Processor
22:16:29  Stepping:            0
22:16:29  CPU MHz:             2799.998
22:16:29  BogoMIPS:            5599.99
22:16:29  Virtualization:      AMD-V
22:16:29  Hypervisor vendor:   KVM
22:16:29  Virtualization type: full
22:16:29  L1d cache:           32K
22:16:29  L1i cache:           32K
22:16:29  L2 cache:            512K
22:16:29  L3 cache:            16384K
22:16:29  NUMA node0 CPU(s):   0,1
22:16:29  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
22:16:29  
22:16:29  
22:16:29  ---> nproc:
22:16:29  2
22:16:29  
22:16:29  
22:16:29  ---> df -h:
22:16:29  Filesystem      Size  Used Avail Use% Mounted on
22:16:29  devtmpfs        1.8G     0  1.8G   0% /dev
22:16:29  tmpfs           1.8G     0  1.8G   0% /dev/shm
22:16:29  tmpfs           1.8G   17M  1.8G   1% /run
22:16:29  tmpfs           1.8G     0  1.8G   0% /sys/fs/cgroup
22:16:29  /dev/vda1        20G   15G  5.4G  74% /
22:16:29  tmpfs           367M     0  367M   0% /run/user/1001
22:16:29  
22:16:29  
22:16:29  ---> free -m:
22:16:29                total        used        free      shared  buff/cache   available
22:16:29  Mem:           3665         470        1219          17        1975        2889
22:16:29  Swap:          1023           0        1023
22:16:29  
22:16:29  
22:16:29  ---> ip addr:
22:16:29  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
22:16:29      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
22:16:29      inet 127.0.0.1/8 scope host lo
22:16:29         valid_lft forever preferred_lft forever
22:16:29      inet6 ::1/128 scope host 
22:16:29         valid_lft forever preferred_lft forever
22:16:29  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
22:16:29      link/ether fa:16:3e:0f:27:67 brd ff:ff:ff:ff:ff:ff
22:16:29      altname enp0s3
22:16:29      altname ens3
22:16:29      inet 10.32.7.167/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
22:16:29         valid_lft 85664sec preferred_lft 85664sec
22:16:29      inet6 fe80::f816:3eff:fe0f:2767/64 scope link 
22:16:29         valid_lft forever preferred_lft forever
22:16:29  
22:16:29  
22:16:29  ---> sar -b -r -n DEV:
22:16:29  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/12/2026 	_x86_64_	(2 CPU)
22:16:29  
22:16:29  22:03:48     LINUX RESTART	(2 CPU)
22:16:29  
22:16:29  10:05:02 PM       tps      rtps      wtps   bread/s   bwrtn/s
22:16:29  10:06:02 PM     57.53      6.56     50.97    951.30   5431.74
22:16:29  10:07:01 PM     59.35      0.75     58.61    205.49   8573.16
22:16:29  10:08:01 PM     49.05      0.47     48.58     60.11  12986.02
22:16:29  10:09:01 PM     34.61      0.05     34.56      1.33   4045.74
22:16:29  10:10:01 PM    118.80      1.68    117.12    346.24 169058.37
22:16:29  10:11:01 PM    126.74      4.58    122.16    483.33 171464.80
22:16:29  10:12:01 PM     80.38      3.48     76.89    497.35  41723.97
22:16:29  10:13:01 PM     84.80      0.15     84.65      4.40   2179.10
22:16:29  10:14:01 PM     74.74      0.05     74.69      1.60   1928.69
22:16:29  10:15:01 PM     80.44      0.03     80.40      1.07   2047.68
22:16:29  10:16:01 PM    117.66     90.97     26.69   8082.63    767.88
22:16:29  Average:        80.45      9.91     70.54    968.01  38322.98
22:16:29  
22:16:29  10:05:02 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
22:16:29  10:06:02 PM   1385780   3033252   2367896     63.08      2104   1816472    598296     12.46    135784   1944280    136928
22:16:29  10:07:01 PM   1090500   2999484   2663176     70.95      2104   2068488    594608     12.38    138496   2201380    186048
22:16:29  10:08:01 PM    845532   2914228   2908144     77.47      2104   2227108    674436     14.04    154752   2422668     76112
22:16:29  10:09:01 PM    849436   2864576   2904240     77.37      2104   2173592    727136     15.14    179052   2394104     56548
22:16:29  10:10:01 PM    127464   2817676   3626212     96.60      2104   2843892    778964     16.22    237140   3055572    178740
22:16:29  10:11:01 PM    127328   2802088   3626348     96.61      2104   2821720    832496     17.34    287204   3044008    264656
22:16:29  10:12:01 PM   1561680   2916280   2191996     58.40      2104   1502884    722764     15.05    182896   1713204      3604
22:16:29  10:13:01 PM   1497940   2876408   2255736     60.09      2104   1522052    746596     15.55    190748   1755328      3464
22:16:29  10:14:01 PM   1430428   2829568   2323248     61.89      2104   1538752    785896     16.37    197464   1803376      3576
22:16:29  10:15:01 PM   1362728   2779768   2390948     63.70      2104   1556520    823772     17.15    204544   1850280      3636
22:16:29  10:16:01 PM   1291492   2961536   2462184     65.59      2104   1807936    635604     13.24    221688   1897304     10592
22:16:29  Average:      1051846   2890442   2701830     71.98      2104   1989038    720052     14.99    193615   2189228     83991
22:16:29  
22:16:29  10:05:02 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
22:16:29  10:06:02 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:06:02 PM      eth0     47.36     38.98    886.64      5.30      0.00      0.00      0.00      0.00
22:16:29  10:07:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:07:01 PM      eth0     63.17     52.80   1059.18      6.63      0.00      0.00      0.00      0.00
22:16:29  10:08:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:08:01 PM      eth0     40.57     36.65    737.06      5.62      0.00      0.00      0.00      0.00
22:16:29  10:09:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:09:01 PM      eth0      7.37      8.53      4.72      3.67      0.00      0.00      0.00      0.00
22:16:29  10:10:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:10:01 PM      eth0   2225.42   1653.43  43429.55    111.90      0.00      0.00      0.00      0.00
22:16:29  10:11:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:11:01 PM      eth0   2276.67   1677.65  43551.80    114.27      0.00      0.00      0.00      0.00
22:16:29  10:12:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:12:01 PM      eth0    498.97    342.48   8209.81     29.33      0.00      0.00      0.00      0.00
22:16:29  10:13:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:13:01 PM      eth0     48.74     35.38    118.88     12.36      0.00      0.00      0.00      0.00
22:16:29  10:14:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:14:01 PM      eth0     41.00     31.04    106.45     10.82      0.00      0.00      0.00      0.00
22:16:29  10:15:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:15:01 PM      eth0     43.54     32.91    103.85     11.71      0.00      0.00      0.00      0.00
22:16:29  10:16:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  10:16:01 PM      eth0     16.84     15.86     14.63      7.78      0.00      0.00      0.00      0.00
22:16:29  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:29  Average:         eth0    484.36    358.10   8960.69     29.12      0.00      0.00      0.00      0.00
22:16:29  
22:16:29  
22:16:29  ---> sar -P ALL:
22:16:29  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/12/2026 	_x86_64_	(2 CPU)
22:16:29  
22:16:29  22:03:48     LINUX RESTART	(2 CPU)
22:16:29  
22:16:29  10:05:02 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
22:16:29  10:06:02 PM     all     24.52      0.00      3.46      1.64      0.07     70.32
22:16:29  10:06:02 PM       0     14.57      0.00      2.58      1.59      0.05     81.20
22:16:29  10:06:02 PM       1     34.46      0.00      4.34      1.68      0.08     59.43
22:16:29  10:07:01 PM     all     22.57      0.00      3.53      2.32      0.08     71.51
22:16:29  10:07:01 PM       0     15.92      0.00      3.29      2.90      0.07     77.82
22:16:29  10:07:01 PM       1     29.22      0.00      3.76      1.73      0.08     65.20
22:16:29  10:08:01 PM     all     28.84      0.00      2.78      1.80      0.10     66.48
22:16:29  10:08:01 PM       0     11.97      0.00      2.02      3.24      0.08     82.68
22:16:29  10:08:01 PM       1     45.69      0.00      3.54      0.37      0.12     50.29
22:16:29  10:09:01 PM     all     25.88      0.00      2.39      1.02      0.08     70.63
22:16:29  10:09:01 PM       0      9.57      0.00      1.75      1.25      0.07     87.36
22:16:29  10:09:01 PM       1     42.18      0.00      3.02      0.78      0.10     53.92
22:16:29  10:10:01 PM     all     21.92      0.00     12.62      2.99      0.11     62.36
22:16:29  10:10:01 PM       0     13.78      0.00      8.87      2.71      0.08     74.56
22:16:29  10:10:01 PM       1     30.19      0.00     16.43      3.28      0.14     49.97
22:16:29  10:11:01 PM     all     22.15      0.00     12.83      2.78      0.12     62.12
22:16:29  10:11:01 PM       0     16.36      0.00      9.93      2.93      0.10     70.67
22:16:29  10:11:01 PM       1     28.02      0.00     15.78      2.62      0.14     53.43
22:16:29  10:12:01 PM     all     32.06      0.00      3.93      1.21      0.09     62.71
22:16:29  10:12:01 PM       0     21.45      0.00      2.47      0.97      0.07     75.04
22:16:29  10:12:01 PM       1     42.70      0.00      5.38      1.46      0.12     50.34
22:16:29  10:13:01 PM     all     40.57      0.00      1.46      0.65      0.12     57.20
22:16:29  10:13:01 PM       0     11.62      0.00      0.97      0.42      0.07     86.93
22:16:29  10:13:01 PM       1     69.48      0.00      1.95      0.89      0.17     27.51
22:16:29  10:14:01 PM     all     41.65      0.00      1.30      0.46      0.12     56.47
22:16:29  10:14:01 PM       0     28.71      0.00      1.10      0.48      0.10     69.60
22:16:29  10:14:01 PM       1     54.57      0.00      1.50      0.43      0.13     43.36
22:16:29  10:15:01 PM     all     40.99      0.00      1.48      0.63      0.12     56.79
22:16:29  10:15:01 PM       0     12.57      0.00      1.04      0.30      0.08     86.01
22:16:29  10:15:01 PM       1     69.39      0.00      1.92      0.95      0.15     27.59
22:16:29  10:16:01 PM     all     27.79      0.00      2.95      6.54      0.09     62.63
22:16:29  10:16:01 PM       0     16.42      0.00      2.76     11.42      0.08     69.31
22:16:29  10:16:01 PM       1     39.13      0.00      3.14      1.67      0.10     55.95
22:16:29  
22:16:29  Average:        CPU     %user     %nice   %system   %iowait    %steal     %idle
22:16:29  Average:        all     29.93      0.00      4.42      2.00      0.10     63.55
22:16:29  Average:          0     15.72      0.00      3.34      2.57      0.08     78.29
22:16:29  Average:          1     44.18      0.00      5.49      1.44      0.12     48.77
22:16:29  
22:16:29  
22:16:29