16:19:52  Started by timer
16:19:52  Running as SYSTEM
16:19:52  [EnvInject] - Loading node environment variables.
16:19:52  Building remotely on prd-centos8-builder-2c-4g-11378 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
16:19:52  [ssh-agent] Looking for ssh-agent implementation...
16:19:52  $ ssh-agent
16:19:52  SSH_AUTH_SOCK=/tmp/ssh-ELpeDNWOdy4A/agent.5184
16:19:52  SSH_AGENT_PID=5186
16:19:52  [ssh-agent] Started.
16:19:52  Running ssh-add (command line suppressed)
16:19:52  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_2404115120729854057.key (jenkins-ssh)
16:19:52  [ssh-agent] Using credentials jenkins (jenkins)
16:19:52  The recommended git tool is: NONE
16:19:54  using credential jenkins
16:19:55  Wiping out workspace first.
16:19:55  Cloning the remote Git repository
16:19:55  Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:19:55   > git init /w/workspace/ci-management-openstack-cron # timeout=10
16:19:55  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:19:55   > git --version # timeout=10
16:19:55   > git --version # 'git version 2.43.0'
16:19:55  using GIT_SSH to set credentials jenkins
16:19:55  [INFO] Currently running in a labeled security context
16:19:55  [INFO] Currently SELinux is 'enforcing' on the host
16:19:55   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh10230237284299373859.key
16:19:55   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
16:19:59   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
16:19:59   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
16:19:59  Avoid second fetch
16:19:59   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
16:19:59  Checking out Revision fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c (refs/remotes/origin/master)
16:19:59   > git config core.sparsecheckout # timeout=10
16:19:59   > git checkout -f fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10
16:20:00  Commit message: "Chore: Update global-jjb to v0.95.0"
16:20:00   > git rev-list --no-walk fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10
16:20:00   > git remote # timeout=10
16:20:00   > git submodule init # timeout=10
16:20:00   > git submodule sync # timeout=10
16:20:00   > git config --get remote.origin.url # timeout=10
16:20:00   > git submodule init # timeout=10
16:20:00   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
16:20:00   > git config --get submodule.packer/common-packer.url # timeout=10
16:20:00   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
16:20:00   > git config --get submodule.global-jjb.url # timeout=10
16:20:00   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
16:20:00   > git submodule update --init --recursive packer/common-packer # timeout=10
16:20:05   > git submodule update --init --recursive global-jjb # timeout=10
16:20:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:20:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:20:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:20:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:20:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:20:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:20:17  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
16:20:17  provisioning config files...
16:20:17  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
16:20:17  copy managed file [npmrc] to file:/home/jenkins/.npmrc
16:20:17  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
16:20:17  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4073337211160775889.sh
16:20:17  ---> python-tools-install.sh
16:20:17  Setup pyenv:
16:20:17    system
16:20:17  * 3.8.13 (set by /opt/pyenv/version)
16:20:17  * 3.9.13 (set by /opt/pyenv/version)
16:20:18  * 3.10.6 (set by /opt/pyenv/version)
16:20:22  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-PCht
16:20:22  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
16:20:22  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:20:30  lf-activate-venv(): INFO: Installing additional packages: lftools 
16:21:07  lf-activate-venv(): INFO: Adding /tmp/venv-PCht/bin to PATH
16:21:07  Generating Requirements File
16:21:49  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
16:21:49  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
16:21:50  Python 3.10.6
16:21:50  pip 26.2.1 from /tmp/venv-PCht/lib/python3.10/site-packages/pip (python 3.10)
16:21:50  aiohappyeyeballs==2.7.1
16:21:50  aiohttp==3.14.3
16:21:50  aiosignal==1.4.0
16:21:50  appdirs==1.4.4
16:21:50  argcomplete==3.7.2
16:21:50  aspy.yaml==1.3.0
16:21:50  async-timeout==5.0.1
16:21:50  attrs==26.1.0
16:21:50  autopage==0.6.0
16:21:50  backports.strenum==1.3.1
16:21:50  beautifulsoup4==4.15.0
16:21:50  boto3==1.43.91
16:21:50  botocore==1.43.91
16:21:50  bs4==0.0.2
16:21:50  certifi==2026.7.22
16:21:50  cffi==2.1.1
16:21:50  cfgv==3.5.0
16:21:50  chardet==7.6.0
16:21:50  charset-normalizer==3.5.1
16:21:50  click==8.5.0
16:21:50  cliff==4.14.0
16:21:50  cmd2==3.5.1
16:21:50  cryptography==3.3.2
16:21:50  debtcollector==3.1.0
16:21:50  decorator==5.3.1
16:21:50  defusedxml==0.7.1
16:21:50  Deprecated==1.3.1
16:21:50  distlib==0.4.3
16:21:50  dnspython==2.8.0
16:21:50  docker==7.2.0
16:21:50  dogpile.cache==1.5.0
16:21:50  durationpy==0.11
16:21:50  email-validator==2.3.0
16:21:50  filelock==3.32.6
16:21:50  frozenlist==1.8.0
16:21:50  future==1.0.0
16:21:50  gitdb==4.0.12
16:21:50  GitPython==3.1.62
16:21:50  httplib2==0.30.2
16:21:50  identify==2.6.19
16:21:50  idna==3.19
16:21:50  importlib-resources==1.5.0
16:21:50  iso8601==2.1.0
16:21:50  Jinja2==3.1.6
16:21:50  jmespath==1.1.0
16:21:50  jsonpatch==1.33
16:21:50  jsonpointer==3.1.1
16:21:50  jsonschema==4.26.0
16:21:50  jsonschema-specifications==2025.9.1
16:21:50  keystoneauth1==5.14.0
16:21:50  kubernetes==36.0.3
16:21:50  lftools==0.37.23
16:21:50  lxml==6.1.3
16:21:50  markdown-it-py==4.2.0
16:21:50  MarkupSafe==3.0.3
16:21:50  mdurl==0.1.2
16:21:50  msgpack==1.2.2
16:21:50  multi_key_dict==2.0.3
16:21:50  multidict==6.8.0
16:21:50  munch==4.0.0
16:21:50  netaddr==1.3.0
16:21:50  niet==1.4.2
16:21:50  nodeenv==1.10.0
16:21:50  oauth2client==4.1.3
16:21:50  oauthlib==3.3.1
16:21:50  openstacksdk==4.13.0
16:21:50  os-service-types==1.8.2
16:21:50  osc-lib==4.6.0
16:21:50  oslo.config==10.4.0
16:21:50  oslo.context==6.4.0
16:21:50  oslo.i18n==6.8.0
16:21:50  oslo.log==8.2.0
16:21:50  oslo.serialization==5.10.0
16:21:50  oslo.utils==10.1.1
16:21:50  packaging==26.3
16:21:50  pbr==7.0.3
16:21:50  platformdirs==4.11.8
16:21:50  prettytable==3.18.0
16:21:50  propcache==0.5.2
16:21:50  psutil==7.2.2
16:21:50  pyasn1==0.6.4
16:21:50  pyasn1_modules==0.4.2
16:21:50  pycparser==3.0
16:21:50  pygerrit2==2.0.15
16:21:50  PyGithub==2.10.0
16:21:50  Pygments==2.21.0
16:21:50  PyJWT==2.13.0
16:21:50  PyNaCl==1.6.2
16:21:50  pyparsing==2.4.7
16:21:50  pyperclip==1.11.0
16:21:50  pyrsistent==0.20.0
16:21:50  python-cinderclient==9.9.0
16:21:50  python-dateutil==2.9.0.post0
16:21:50  python-discovery==1.6.0
16:21:50  python-heatclient==5.2.0
16:21:50  python-jenkins==1.8.3
16:21:50  python-keystoneclient==6.0.0
16:21:50  python-magnumclient==4.11.0
16:21:50  python-openstackclient==10.0.0
16:21:50  python-swiftclient==4.11.0
16:21:50  PyYAML==6.0.3
16:21:50  referencing==0.37.0
16:21:50  requests==2.34.2
16:21:50  requests-oauthlib==2.0.0
16:21:50  rfc3986==2.0.0
16:21:50  rich==15.0.0
16:21:50  rich-argparse==1.8.0
16:21:50  rpds-py==0.30.0
16:21:50  rsa==4.9.1
16:21:50  ruamel.yaml==0.19.1
16:21:50  ruamel.yaml.clib==0.2.15
16:21:50  s3transfer==0.19.2
16:21:50  simplejson==4.1.2
16:21:50  six==1.17.0
16:21:50  smmap==5.0.3
16:21:50  soupsieve==2.9.2
16:21:50  stevedore==5.8.0
16:21:50  tabulate==0.10.0
16:21:50  toml==0.10.2
16:21:50  tomlkit==0.15.1
16:21:50  tqdm==4.70.0
16:21:50  typing_extensions==4.16.0
16:21:50  urllib3==1.26.20
16:21:50  virtualenv==21.7.9
16:21:50  wcwidth==0.8.3
16:21:50  websocket-client==1.9.2
16:21:50  wrapt==2.4.0
16:21:50  xdg==6.0.0
16:21:50  xmltodict==1.0.4
16:21:50  yarl==1.24.5
16:21:50  yq==4.1.2
16:21:50  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins14785102434721715992.sh
16:21:50  ---> uv-install.sh
16:21:50  Installing uv/uvx (latest) using shell installer
16:21:57  2026-09-11 16:21:57 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71308/71308] -> "/tmp/uv-install-OxEXme.sh" [1]
16:21:57  downloading uv 0.12.13 x86_64-unknown-linux-gnu
16:22:01  installing to /home/jenkins/.local/bin
16:22:01    uv
16:22:01    uvx
16:22:01  everything's installed!
16:22:01  ---> Validating uv/uvx install
16:22:01  uvx 0.12.13 (x86_64-unknown-linux-gnu)
16:22:01  [EnvInject] - Injecting environment variables from a build step.
16:22:01  [EnvInject] - Injecting as environment variables the properties content 
16:22:01  OS_CLOUD=vex
16:22:01  
16:22:01  [EnvInject] - Variables injected successfully.
16:22:01  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
16:22:01  Run condition [Boolean condition] enabling perform for step [Execute shell]
16:22:01  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins1315718303103054255.sh
16:22:01  ---> Orphaned k8s clusters
16:22:01  Setup pyenv:
16:22:02    system
16:22:02    3.8.13
16:22:02    3.9.13
16:22:02  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:22:02  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PCht from file:/tmp/.os_lf_venv
16:22:02  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:22:07  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
16:22:22  lf-activate-venv(): INFO: Adding /tmp/venv-PCht/bin to PATH
16:25:30  Gateway Timeout (HTTP 504)
16:25:30  -----> Delete orphaned cluster
16:25:30  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
16:25:30  Run condition [Boolean condition] enabling perform for step [Execute shell]
16:25:30  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins18443632979899178386.sh
16:25:30  ---> Orphaned stacks
16:25:30  Setup pyenv:
16:25:30    system
16:25:30    3.8.13
16:25:30    3.9.13
16:25:30  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:25:31  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PCht from file:/tmp/.os_lf_venv
16:25:31  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:25:36  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
16:26:01  lf-activate-venv(): INFO: Adding /tmp/venv-PCht/bin to PATH
16:26:01  + mapfile -t OS_COE_CLUSTERS_ID
16:26:01  ++ awk '{print $1}'
16:26:01  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
16:26:01  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
16:29:09  Gateway Timeout (HTTP 504)
16:29:09  + echo '-----> Active clusters -> stacks'
16:29:09  -----> Active clusters -> stacks
16:29:09  + OS_COE_STACKS=()
16:29:09  + [[ 0 -gt 0 ]]
16:29:09  + mapfile -t OS_STACKS
16:29:09  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
16:29:09  ++ awk '{print $1}'
16:29:18  + echo '-----> Active stacks'
16:29:18  -----> Active stacks
16:29:18  + echo '-----> Delete orphaned stacks'
16:29:18  -----> Delete orphaned stacks
16:29:18  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
16:29:18  Run condition [Boolean condition] enabling perform for step [Execute shell]
16:29:18  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins18301209190370310934.sh
16:29:18  ---> Orphaned servers
16:29:18  Setup pyenv:
16:29:18    system
16:29:18    3.8.13
16:29:18    3.9.13
16:29:18  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:29:18  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PCht from file:/tmp/.os_lf_venv
16:29:18  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:29:23  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
16:29:46  lf-activate-venv(): INFO: Adding /tmp/venv-PCht/bin to PATH
16:30:00  -----> Active servers
16:30:00  prd-centos8-builder-2c-4g-11378
16:30:00  -----> Delete orphaned servers
16:30:07  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
16:30:07  Run condition [Boolean condition] enabling perform for step [Execute shell]
16:30:07  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins6041612987192724354.sh
16:30:07  ---> Orphaned ports
16:30:07  Setup pyenv:
16:30:07    system
16:30:07    3.8.13
16:30:07    3.9.13
16:30:07  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:30:07  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PCht from file:/tmp/.os_lf_venv
16:30:07  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:30:12  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 
16:30:17  Build timed out (after 10 minutes). Marking the build as failed.
16:30:17  $ ssh-agent -k
16:30:17  unset SSH_AUTH_SOCK;
16:30:17  unset SSH_AGENT_PID;
16:30:17  echo Agent pid 5186 killed;
16:30:17  [ssh-agent] Stopped.
16:30:17  Build was aborted
16:30:17  [PostBuildScript] - [INFO] Executing post build scripts.
16:30:17  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16282049373641287238.sh
16:30:17  ---> sysstat.sh
16:30:17  /home/jenkins/lf-env.sh: line 73:  6928 Terminated              "$venv_python" -m pip install "$@"
16:30:17  lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple
16:30:18  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7216204304224265835.sh
16:30:18  ---> package-listing.sh
16:30:18  ++ facter osfamily
16:30:18  ++ tr '[:upper:]' '[:lower:]'
16:30:18  + OS_FAMILY=redhat
16:30:18  + workspace=/w/workspace/ci-management-openstack-cron
16:30:18  + START_PACKAGES=/tmp/packages_start.txt
16:30:18  + END_PACKAGES=/tmp/packages_end.txt
16:30:18  + DIFF_PACKAGES=/tmp/packages_diff.txt
16:30:18  + PACKAGES=/tmp/packages_start.txt
16:30:18  + '[' /w/workspace/ci-management-openstack-cron ']'
16:30:18  + PACKAGES=/tmp/packages_end.txt
16:30:18  + case "${OS_FAMILY}" in
16:30:18  + rpm -qa
16:30:18  + sort
16:30:19  + '[' -f /tmp/packages_start.txt ']'
16:30:19  + '[' -f /tmp/packages_end.txt ']'
16:30:19  + diff /tmp/packages_start.txt /tmp/packages_end.txt
16:30:19  + '[' /w/workspace/ci-management-openstack-cron ']'
16:30:19  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
16:30:19  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
16:30:19  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9988583632846481962.sh
16:30:19  ---> capture-instance-metadata.sh
16:30:19  Setup pyenv:
16:30:19    system
16:30:19    3.8.13
16:30:19    3.9.13
16:30:19  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:30:19  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PCht from file:/tmp/.os_lf_venv
16:30:19  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:30:22  lf-activate-venv(): INFO: Installing additional packages: lftools 
16:30:34  WARNING: Error parsing dependencies of setuptools: [Errno 2] No such file or directory: '/tmp/venv-PCht/lib/python3.10/site-packages/setuptools-65.7.0.dist-info/METADATA'
16:30:34      WARNING: No metadata found in /tmp/venv-PCht/lib/python3.10/site-packages
16:30:35  lf-activate-venv(): INFO: Adding /tmp/venv-PCht/bin to PATH
16:30:35  INFO: Running in OpenStack, capturing instance metadata
16:30:36  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins18231036832439497725.sh
16:30:36  provisioning config files...
16:30:36  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config5531130917872597748tmp
16:30:36  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
16:30:36  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
16:30:36  [EnvInject] - Injecting environment variables from a build step.
16:30:36  [EnvInject] - Injecting as environment variables the properties content 
16:30:36  SERVER_ID=logs
16:30:36  
16:30:36  [EnvInject] - Variables injected successfully.
16:30:36  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins15934285743861910911.sh
16:30:36  ---> create-netrc.sh
16:30:36  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3983702155236706042.sh
16:30:36  ---> python-tools-install.sh
16:30:36  Setup pyenv:
16:30:36    system
16:30:36    3.8.13
16:30:36    3.9.13
16:30:36  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:30:37  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PCht from file:/tmp/.os_lf_venv
16:30:37  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:30:42  lf-activate-venv(): INFO: Installing additional packages: lftools 
16:30:57  lf-activate-venv(): INFO: Adding /tmp/venv-PCht/bin to PATH
16:30:57  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins17818131672964592764.sh
16:30:57  ---> uv-install.sh
16:30:57  uv 0.12.13 is already installed
16:30:57  uvx 0.12.13 (x86_64-unknown-linux-gnu)
16:30:57  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3229100119603159843.sh
16:30:57  ---> sudo-logs.sh
16:30:57  Archiving 'sudo' log..
16:30:57  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins5522034570474855344.sh
16:30:57  ---> job-cost.sh
16:30:57  INFO: Activating Python virtual environment...
16:30:57  Setup pyenv:
16:30:57    system
16:30:57    3.8.13
16:30:57    3.9.13
16:30:57  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:30:57  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PCht from file:/tmp/.os_lf_venv
16:30:57  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:31:02  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
16:31:14  lf-activate-venv(): INFO: Adding /tmp/venv-PCht/bin to PATH
16:31:14  INFO: No stack-cost file found
16:31:14  INFO: Instance uptime: 744s
16:31:14  INFO: Fetching instance metadata (attempt 1 of 3)...
16:31:14  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
16:31:15  INFO: Successfully fetched instance metadata
16:31:15  INFO: Instance type: v3-starter-2
16:31:15  INFO: Retrieving pricing info for: v3-starter-2
16:31:15  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
16:31:15  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=744
16:31:18  INFO: Successfully fetched Vexxhost pricing API
16:31:18  INFO: Retrieved cost: 0.02
16:31:18  INFO: Retrieved resource: v3-starter-2
16:31:18  INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost
16:31:18  INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv
16:31:18  INFO: Successfully archived job cost data
16:31:18  DEBUG: Cost data: ci-management-openstack-cron,62309,2026-09-11 16:31:18,v3-starter-2,744,0.02,0.00,FAILURE
16:31:18  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins15474560178689907781.sh
16:31:18  ---> logs-deploy.sh
16:31:18  Setup pyenv:
16:31:18    system
16:31:18    3.8.13
16:31:18    3.9.13
16:31:18  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:31:18  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PCht from file:/tmp/.os_lf_venv
16:31:18  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:31:23  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
16:31:39  lf-activate-venv(): INFO: Adding /tmp/venv-PCht/bin to PATH
16:31:39  INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/62309
16:31:39  INFO: archiving workspace using pattern(s): 
16:31:43  Archives upload complete.
16:31:43  INFO: archiving logs to Nexus
16:31:44  ---> uname -a:
16:31:44  Linux prd-centos8-builder-2c-4g-11378.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
16:31:44  
16:31:44  
16:31:44  ---> lscpu:
16:31:44  Architecture:        x86_64
16:31:44  CPU op-mode(s):      32-bit, 64-bit
16:31:44  Byte Order:          Little Endian
16:31:44  CPU(s):              2
16:31:44  On-line CPU(s) list: 0,1
16:31:44  Thread(s) per core:  1
16:31:44  Core(s) per socket:  1
16:31:44  Socket(s):           2
16:31:44  NUMA node(s):        1
16:31:44  Vendor ID:           AuthenticAMD
16:31:44  CPU family:          23
16:31:44  Model:               49
16:31:44  Model name:          AMD EPYC-Rome Processor
16:31:44  Stepping:            0
16:31:44  CPU MHz:             2799.998
16:31:44  BogoMIPS:            5599.99
16:31:44  Virtualization:      AMD-V
16:31:44  Hypervisor vendor:   KVM
16:31:44  Virtualization type: full
16:31:44  L1d cache:           32K
16:31:44  L1i cache:           32K
16:31:44  L2 cache:            512K
16:31:44  L3 cache:            16384K
16:31:44  NUMA node0 CPU(s):   0,1
16:31:44  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
16:31:44  
16:31:44  
16:31:44  ---> nproc:
16:31:44  2
16:31:44  
16:31:44  
16:31:44  ---> df -h:
16:31:44  Filesystem      Size  Used Avail Use% Mounted on
16:31:44  devtmpfs        1.8G     0  1.8G   0% /dev
16:31:44  tmpfs           1.8G     0  1.8G   0% /dev/shm
16:31:44  tmpfs           1.8G   17M  1.8G   1% /run
16:31:44  tmpfs           1.8G     0  1.8G   0% /sys/fs/cgroup
16:31:44  /dev/vda1        20G  9.2G   11G  46% /
16:31:44  tmpfs           367M     0  367M   0% /run/user/1001
16:31:44  
16:31:44  
16:31:44  ---> free -m:
16:31:44                total        used        free      shared  buff/cache   available
16:31:44  Mem:           3665         483         983          17        2198        2904
16:31:44  Swap:          1023           0        1023
16:31:44  
16:31:44  
16:31:44  ---> ip addr:
16:31:44  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
16:31:44      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
16:31:44      inet 127.0.0.1/8 scope host lo
16:31:44         valid_lft forever preferred_lft forever
16:31:44      inet6 ::1/128 scope host 
16:31:44         valid_lft forever preferred_lft forever
16:31:44  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
16:31:44      link/ether fa:16:3e:a2:d9:33 brd ff:ff:ff:ff:ff:ff
16:31:44      altname enp0s3
16:31:44      altname ens3
16:31:44      inet 10.32.6.176/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
16:31:44         valid_lft 85659sec preferred_lft 85659sec
16:31:44      inet6 fe80::f816:3eff:fea2:d933/64 scope link 
16:31:44         valid_lft forever preferred_lft forever
16:31:44  
16:31:44  
16:31:44  ---> sar -b -r -n DEV:
16:31:44  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	09/11/2026 	_x86_64_	(2 CPU)
16:31:44  
16:31:44  16:18:59     LINUX RESTART	(2 CPU)
16:31:44  
16:31:44  04:20:00 PM       tps      rtps      wtps   bread/s   bwrtn/s
16:31:44  04:20:01 PM      1.45      1.45      0.00     46.38      0.00
16:31:44  04:21:01 PM     77.96      6.50     71.46    954.75   5000.77
16:31:44  04:22:01 PM     65.32      0.60     64.72    151.04   7976.34
16:31:44  04:23:01 PM     26.13      0.65     25.48     83.85   7200.18
16:31:44  04:24:01 PM      1.47      0.00      1.47      0.00     45.73
16:31:44  04:25:01 PM      0.17      0.00      0.17      0.00      1.67
16:31:44  04:26:01 PM     13.61      0.00     13.61      0.00   1615.88
16:31:44  04:27:01 PM      9.71      0.05      9.66      1.33    728.77
16:31:44  04:28:01 PM      2.55      0.00      2.55      0.00     85.05
16:31:44  04:29:01 PM      0.17      0.00      0.17      0.00      2.12
16:31:44  04:30:00 PM      9.91      0.00      9.91      0.00    227.43
16:31:44  04:30:01 PM      0.00      0.00      0.00      0.00      0.00
16:31:44  04:31:01 PM     30.21      0.62     29.59     79.44   1611.76
16:31:44  Average:        21.53      0.77     20.76    115.42   2224.19
16:31:44  
16:31:44  04:20:00 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
16:31:44  04:20:01 PM   1726528   3116728   2027148     54.00      2104   1572872    568776     11.84    121008   1670668     35100
16:31:44  04:21:01 PM   1385872   2987628   2367804     63.08      2104   1777324    675128     14.06    156332   1949604     93776
16:31:44  04:22:01 PM   1198200   3048732   2555476     68.08      2104   2010712    568152     11.83    144540   2090876    149740
16:31:44  04:23:01 PM   1092960   2987164   2660716     70.88      2104   2053752    618108     12.87    146800   2188188        12
16:31:44  04:24:01 PM   1092796   2986964   2660880     70.89      2104   2053752    618108     12.87    146800   2188124         4
16:31:44  04:25:01 PM   1092012   2986184   2661664     70.91      2104   2053756    618108     12.87    146800   2188304        12
16:31:44  04:26:01 PM   1107640   3041796   2646036     70.49      2104   2092792    556504     11.59    149632   2169300     19436
16:31:44  04:27:01 PM   1058496   2992032   2695180     71.80      2104   2092832    610916     12.72    159500   2208820         4
16:31:44  04:28:01 PM   1057688   2991228   2695988     71.82      2104   2092836    610916     12.72    159500   2208988         8
16:31:44  04:29:01 PM   1057844   2991384   2695832     71.82      2104   2092836    610916     12.72    159500   2208988         4
16:31:44  04:30:00 PM   1056952   2990708   2696724     71.84      2104   2092820    609124     12.68    174476   2195848      6736
16:31:44  04:30:01 PM   1111420   3045196   2642256     70.39      2104   2092824    565112     11.77    175140   2140628      6752
16:31:44  04:31:01 PM   1054392   3017664   2699284     71.91      2104   2121012    585508     12.19    368516   2002488     35500
16:31:44  Average:      1160985   3014108   2592691     69.07      2104   2015394    601183     12.52    169888   2108525     26699
16:31:44  
16:31:44  04:20:00 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
16:31:44  04:20:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:20:01 PM      eth0   1627.54    663.77   4865.53    410.18      0.00      0.00      0.00      0.00
16:31:44  04:21:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:21:01 PM      eth0     79.31     64.00    941.67     10.28      0.00      0.00      0.00      0.00
16:31:44  04:22:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:22:01 PM      eth0     44.34     39.94    624.39      5.00      0.00      0.00      0.00      0.00
16:31:44  04:23:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:23:01 PM      eth0      9.23      8.93     60.23      2.28      0.00      0.00      0.00      0.00
16:31:44  04:24:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:24:01 PM      eth0      0.20      0.18      0.01      0.01      0.00      0.00      0.00      0.00
16:31:44  04:25:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:25:01 PM      eth0      0.28      0.22      0.09      0.07      0.00      0.00      0.00      0.00
16:31:44  04:26:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:26:01 PM      eth0     35.08     31.60    648.92      4.59      0.00      0.00      0.00      0.00
16:31:44  04:27:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:27:01 PM      eth0      0.67      0.62      0.67      0.08      0.00      0.00      0.00      0.00
16:31:44  04:28:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:28:01 PM      eth0      0.28      0.22      0.14      0.01      0.00      0.00      0.00      0.00
16:31:44  04:29:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:29:01 PM      eth0      0.13      0.13      0.01      0.01      0.00      0.00      0.00      0.00
16:31:44  04:30:00 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:30:00 PM      eth0      8.05      8.82      8.62      3.40      0.00      0.00      0.00      0.00
16:31:44  04:30:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:30:01 PM      eth0     13.95     17.44     24.24      2.13      0.00      0.00      0.00      0.00
16:31:44  04:31:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  04:31:01 PM      eth0     83.67     59.36    413.34     11.74      0.00      0.00      0.00      0.00
16:31:44  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:31:44  Average:         eth0     25.43     20.14    250.14      3.83      0.00      0.00      0.00      0.00
16:31:44  
16:31:44  
16:31:44  ---> sar -P ALL:
16:31:44  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	09/11/2026 	_x86_64_	(2 CPU)
16:31:44  
16:31:44  16:18:59     LINUX RESTART	(2 CPU)
16:31:44  
16:31:44  04:20:00 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
16:31:44  04:20:01 PM     all     20.86      0.00     10.79      0.00      0.00     68.35
16:31:44  04:20:01 PM       0     22.86      0.00     10.00      0.00      0.00     67.14
16:31:44  04:20:01 PM       1     18.84      0.00     11.59      0.00      0.00     69.57
16:31:44  04:21:01 PM     all     22.13      0.00      3.44      2.98      0.08     71.37
16:31:44  04:21:01 PM       0     20.91      0.00      3.57      4.44      0.08     71.00
16:31:44  04:21:01 PM       1     23.34      0.00      3.31      1.54      0.08     71.73
16:31:44  04:22:01 PM     all     23.98      0.00      3.56      2.08      0.09     70.29
16:31:44  04:22:01 PM       0      8.96      0.00      2.15      2.09      0.07     86.73
16:31:44  04:22:01 PM       1     38.99      0.00      4.97      2.07      0.12     53.85
16:31:44  04:23:01 PM     all     11.13      0.00      1.39      0.84      0.05     86.59
16:31:44  04:23:01 PM       0      7.35      0.00      1.64      0.99      0.03     89.99
16:31:44  04:23:01 PM       1     14.90      0.00      1.13      0.70      0.07     83.19
16:31:44  04:24:01 PM     all      0.32      0.00      0.06      0.03      0.03     99.57
16:31:44  04:24:01 PM       0      0.40      0.00      0.08      0.00      0.03     99.48
16:31:44  04:24:01 PM       1      0.23      0.00      0.03      0.05      0.02     99.67
16:31:44  04:25:01 PM     all      0.33      0.00      0.08      0.00      0.03     99.57
16:31:44  04:25:01 PM       0      0.07      0.00      0.08      0.00      0.02     99.83
16:31:44  04:25:01 PM       1      0.58      0.00      0.07      0.00      0.03     99.32
16:31:44  04:26:01 PM     all     16.33      0.00      1.39      0.17      0.06     82.06
16:31:44  04:26:01 PM       0     15.05      0.00      1.37      0.28      0.05     83.24
16:31:44  04:26:01 PM       1     17.61      0.00      1.40      0.05      0.07     80.87
16:31:44  04:27:01 PM     all      0.96      0.00      0.20      0.37      0.03     98.44
16:31:44  04:27:01 PM       0      0.59      0.00      0.13      0.45      0.05     98.78
16:31:44  04:27:01 PM       1      1.33      0.00      0.27      0.28      0.02     98.10
16:31:44  04:28:01 PM     all      0.34      0.00      0.04      0.05      0.02     99.55
16:31:44  04:28:01 PM       0      0.15      0.00      0.07      0.10      0.03     99.65
16:31:44  04:28:01 PM       1      0.53      0.00      0.02      0.00      0.00     99.45
16:31:44  04:29:01 PM     all      0.33      0.00      0.07      0.00      0.03     99.57
16:31:44  04:29:01 PM       0      0.13      0.00      0.08      0.00      0.03     99.75
16:31:44  04:29:01 PM       1      0.53      0.00      0.05      0.00      0.02     99.40
16:31:44  04:30:00 PM     all     17.40      0.00      1.14      0.12      0.06     81.28
16:31:44  04:30:00 PM       0     12.03      0.00      1.00      0.03      0.05     86.88
16:31:44  04:30:00 PM       1     22.76      0.00      1.29      0.20      0.07     75.69
16:31:44  
16:31:44  04:30:00 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
16:31:44  04:30:01 PM     all     11.11      0.00      1.75      0.00      0.00     87.13
16:31:44  04:30:01 PM       0      2.35      0.00      2.35      0.00      0.00     95.29
16:31:44  04:30:01 PM       1     19.77      0.00      1.16      0.00      0.00     79.07
16:31:44  04:31:01 PM     all     31.25      0.00      3.22      0.25      0.08     65.20
16:31:44  04:31:01 PM       0     36.67      0.00      2.83      0.28      0.08     60.14
16:31:44  04:31:01 PM       1     25.84      0.00      3.60      0.22      0.08     70.25
16:31:44  Average:        all     11.32      0.00      1.34      0.62      0.05     86.67
16:31:44  Average:          0      9.30      0.00      1.19      0.79      0.05     88.67
16:31:44  Average:          1     13.33      0.00      1.48      0.46      0.05     84.68
16:31:44  
16:31:44  
16:31:44