11:51:18 Triggered by Gerrit: https://gerrit.o-ran-sc.org/r/c/ci-management/+/12829 11:51:18 Running as SYSTEM 11:51:18 [EnvInject] - Loading node environment variables. 11:51:18 Building remotely on prd-centos8-builder-1c-1g-3744 (centos8-builder-1c-1g) in workspace /w/workspace/ci-management-jenkins-cfg-verify 11:51:18 [ssh-agent] Looking for ssh-agent implementation... 11:51:18 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 11:51:18 $ ssh-agent 11:51:18 SSH_AUTH_SOCK=/tmp/ssh-YdLiwRqFyXcY/agent.5159 11:51:18 SSH_AGENT_PID=5160 11:51:18 [ssh-agent] Started. 11:51:18 Running ssh-add (command line suppressed) 11:51:18 Identity added: /w/workspace/ci-management-jenkins-cfg-verify@tmp/private_key_6942543251735790985.key (jenkins-ssh) 11:51:18 [ssh-agent] Using credentials jenkins (jenkins) 11:51:18 The recommended git tool is: NONE 11:51:23 using credential jenkins 11:51:23 Wiping out workspace first. 11:51:23 Cloning the remote Git repository 11:51:23 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 11:51:23 > git init /w/workspace/ci-management-jenkins-cfg-verify # timeout=10 11:51:23 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 11:51:23 > git --version # timeout=10 11:51:23 > git --version # 'git version 2.43.0' 11:51:23 using GIT_SSH to set credentials jenkins 11:51:23 [INFO] Currently running in a labeled security context 11:51:23 [INFO] Currently SELinux is 'enforcing' on the host 11:51:23 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-jenkins-cfg-verify@tmp/jenkins-gitclient-ssh13021254841349086651.key 11:51:23 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 11:51:25 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 11:51:25 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 11:51:25 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 11:51:25 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 11:51:25 using GIT_SSH to set credentials jenkins 11:51:25 [INFO] Currently running in a labeled security context 11:51:25 [INFO] Currently SELinux is 'enforcing' on the host 11:51:25 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-jenkins-cfg-verify@tmp/jenkins-gitclient-ssh15511693018411731339.key 11:51:26 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management refs/changes/29/12829/1 # timeout=10 11:51:26 > git rev-parse d886f2d62be33af5865d44ae57949fca35c119f8^{commit} # timeout=10 11:51:26 JENKINS-19022: warning: possible memory leak due to Git plugin usage; see: https://plugins.jenkins.io/git/#remove-git-plugin-buildsbybranch-builddata-script 11:51:26 Checking out Revision d886f2d62be33af5865d44ae57949fca35c119f8 (refs/changes/29/12829/1) 11:51:26 > git config core.sparsecheckout # timeout=10 11:51:26 > git checkout -f d886f2d62be33af5865d44ae57949fca35c119f8 # timeout=10 11:51:30 Commit message: "Chore: Automation adds aiml-fw/awmf/cli config files" 11:51:30 > git rev-parse FETCH_HEAD^{commit} # timeout=10 11:51:30 > git rev-list --no-walk 3ced11a2aea8b7cf99e93d25d512aaa0851d0404 # timeout=10 11:51:30 > git remote # timeout=10 11:51:30 > git submodule init # timeout=10 11:51:30 > git submodule sync # timeout=10 11:51:30 > git config --get remote.origin.url # timeout=10 11:51:30 > git submodule init # timeout=10 11:51:30 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 11:51:30 > git config --get submodule.packer/common-packer.url # timeout=10 11:51:30 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 11:51:30 > git config --get submodule.global-jjb.url # timeout=10 11:51:30 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 11:51:31 > git submodule update --init --recursive packer/common-packer # timeout=10 11:51:31 > git submodule update --init --recursive global-jjb # timeout=10 11:51:33 provisioning config files... 11:51:33 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 11:51:33 copy managed file [npmrc] to file:/home/jenkins/.npmrc 11:51:33 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 11:51:33 [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins3320493599434678219.sh 11:51:33 ---> python-tools-install.sh 11:51:33 Setup pyenv: 11:51:33 system 11:51:33 * 3.8.13 (set by /opt/pyenv/version) 11:51:33 * 3.9.13 (set by /opt/pyenv/version) 11:51:33 * 3.10.6 (set by /opt/pyenv/version) 11:51:38 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-XPWL 11:51:38 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 11:51:42 lf-activate-venv(): INFO: Installing: lftools 11:52:13 lf-activate-venv(): INFO: Adding /tmp/venv-XPWL/bin to PATH 11:52:13 Generating Requirements File 11:52:35 Python 3.10.6 11:52:35 pip 24.2 from /tmp/venv-XPWL/lib/python3.10/site-packages/pip (python 3.10) 11:52:36 appdirs==1.4.4 11:52:36 argcomplete==3.5.0 11:52:36 aspy.yaml==1.3.0 11:52:36 attrs==24.2.0 11:52:36 autopage==0.5.2 11:52:36 beautifulsoup4==4.12.3 11:52:36 boto3==1.35.9 11:52:36 botocore==1.35.9 11:52:36 bs4==0.0.2 11:52:36 cachetools==5.5.0 11:52:36 certifi==2024.7.4 11:52:36 cffi==1.17.0 11:52:36 cfgv==3.4.0 11:52:36 chardet==5.2.0 11:52:36 charset-normalizer==3.3.2 11:52:36 click==8.1.7 11:52:36 cliff==4.7.0 11:52:36 cmd2==2.4.3 11:52:36 cryptography==3.3.2 11:52:36 debtcollector==3.0.0 11:52:36 decorator==5.1.1 11:52:36 defusedxml==0.7.1 11:52:36 Deprecated==1.2.14 11:52:36 distlib==0.3.8 11:52:36 dnspython==2.6.1 11:52:36 docker==4.2.2 11:52:36 dogpile.cache==1.3.3 11:52:36 email_validator==2.2.0 11:52:36 filelock==3.15.4 11:52:36 future==1.0.0 11:52:36 gitdb==4.0.11 11:52:36 GitPython==3.1.43 11:52:36 google-auth==2.34.0 11:52:36 httplib2==0.22.0 11:52:36 identify==2.6.0 11:52:36 idna==3.8 11:52:36 importlib-resources==1.5.0 11:52:36 iso8601==2.1.0 11:52:36 Jinja2==3.1.4 11:52:36 jmespath==1.0.1 11:52:36 jsonpatch==1.33 11:52:36 jsonpointer==3.0.0 11:52:36 jsonschema==4.23.0 11:52:36 jsonschema-specifications==2023.12.1 11:52:36 keystoneauth1==5.8.0 11:52:36 kubernetes==30.1.0 11:52:36 lftools==0.37.10 11:52:36 lxml==5.3.0 11:52:36 MarkupSafe==2.1.5 11:52:36 msgpack==1.0.8 11:52:36 multi_key_dict==2.0.3 11:52:36 munch==4.0.0 11:52:36 netaddr==1.3.0 11:52:36 netifaces==0.11.0 11:52:36 niet==1.4.2 11:52:36 nodeenv==1.9.1 11:52:36 oauth2client==4.1.3 11:52:36 oauthlib==3.2.2 11:52:36 openstacksdk==3.3.0 11:52:36 os-client-config==2.1.0 11:52:36 os-service-types==1.7.0 11:52:36 osc-lib==3.1.0 11:52:36 oslo.config==9.6.0 11:52:36 oslo.context==5.6.0 11:52:36 oslo.i18n==6.4.0 11:52:36 oslo.log==6.1.2 11:52:36 oslo.serialization==5.5.0 11:52:36 oslo.utils==7.3.0 11:52:36 packaging==24.1 11:52:36 pbr==6.1.0 11:52:36 platformdirs==4.2.2 11:52:36 prettytable==3.11.0 11:52:36 pyasn1==0.6.0 11:52:36 pyasn1_modules==0.4.0 11:52:36 pycparser==2.22 11:52:36 pygerrit2==2.0.15 11:52:36 PyGithub==2.4.0 11:52:36 PyJWT==2.9.0 11:52:36 PyNaCl==1.5.0 11:52:36 pyparsing==2.4.7 11:52:36 pyperclip==1.9.0 11:52:36 pyrsistent==0.20.0 11:52:36 python-cinderclient==9.6.0 11:52:36 python-dateutil==2.9.0.post0 11:52:36 python-heatclient==4.0.0 11:52:36 python-jenkins==1.8.2 11:52:36 python-keystoneclient==5.5.0 11:52:36 python-magnumclient==4.6.0 11:52:36 python-openstackclient==7.0.0 11:52:36 python-swiftclient==4.6.0 11:52:36 PyYAML==6.0.2 11:52:36 referencing==0.35.1 11:52:36 requests==2.32.3 11:52:36 requests-oauthlib==2.0.0 11:52:36 requestsexceptions==1.4.0 11:52:36 rfc3986==2.0.0 11:52:36 rpds-py==0.20.0 11:52:36 rsa==4.9 11:52:36 ruamel.yaml==0.18.6 11:52:36 ruamel.yaml.clib==0.2.8 11:52:36 s3transfer==0.10.2 11:52:36 simplejson==3.19.3 11:52:36 six==1.16.0 11:52:36 smmap==5.0.1 11:52:36 soupsieve==2.6 11:52:36 stevedore==5.3.0 11:52:36 tabulate==0.9.0 11:52:36 toml==0.10.2 11:52:36 tomlkit==0.13.2 11:52:36 tqdm==4.66.5 11:52:36 typing_extensions==4.12.2 11:52:36 tzdata==2024.1 11:52:36 urllib3==1.26.20 11:52:36 virtualenv==20.26.3 11:52:36 wcwidth==0.2.13 11:52:36 websocket-client==1.8.0 11:52:36 wrapt==1.16.0 11:52:36 xdg==6.0.0 11:52:36 xmltodict==0.13.0 11:52:36 yq==3.4.3 11:52:36 [ci-management-jenkins-cfg-verify] $ /bin/bash -l /tmp/jenkins4983270478466733756.sh 11:52:36 ---> jenkins-verify-images.sh 11:52:36 + source /home/jenkins/lf-env.sh 11:52:36 + '[' -f /tmp/.os_lf_venv ']' 11:52:36 ++ cat /tmp/.os_lf_venv 11:52:36 + os_lf_venv=/tmp/venv-XPWL 11:52:36 + '[' -d /tmp/venv-XPWL ']' 11:52:36 + '[' -f /tmp/venv-XPWL/bin/openstack ']' 11:52:36 + echo 'Re-use existing venv: /tmp/venv-XPWL' 11:52:36 Re-use existing venv: /tmp/venv-XPWL 11:52:36 + PATH=/tmp/venv-XPWL/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 11:52:36 + error=false 11:52:36 + echo 'Verifying that cloud has a master configuration file' 11:52:36 Verifying that cloud has a master configuration file 11:52:36 + [[ -d jenkins-config/clouds/openstack ]] 11:52:36 + for cloud in jenkins-config/clouds/openstack/* 11:52:36 + [[ -f jenkins-config/clouds/openstack/cattle/cloud.cfg ]] 11:52:36 ++ grep -E '^OS_CLOUD=' jenkins-config/clouds/openstack/cattle/cloud.cfg 11:52:36 ++ cut -d= -f2 11:52:36 + os_cloud= 11:52:36 + os_cloud=vex 11:52:36 + OS_CLOUD=vex 11:52:36 + verify_images jenkins-config/clouds/openstack/cattle 11:52:36 + echo 'Verifying images on jenkins-config/clouds/openstack/cattle' 11:52:36 Verifying images on jenkins-config/clouds/openstack/cattle 11:52:36 + for file in "$1"/* 11:52:36 + '[' -f jenkins-config/clouds/openstack/cattle/centos7-builder-1c-1g.cfg ']' 11:52:36 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos7-builder-1c-1g.cfg 11:52:36 + export 'IMAGE_NAME=ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228' 11:52:36 + IMAGE_NAME='ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228' 11:52:36 + openstack image list --property 'name=ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228' 11:52:36 + grep active 11:52:40 | 4fab7a7c-385a-42b7-a11c-ffe686c5371c | ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228 | active | 11:52:40 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos7-builder-1c-1g.cfg 11:52:40 + export HARDWARE_ID=v2-highcpu-1 11:52:40 + HARDWARE_ID=v2-highcpu-1 11:52:40 + openstack flavor list 11:52:40 + grep ' v2-highcpu-1 ' 11:52:42 | c04abb7a-2b61-4ed3-8ce8-6c40ad9df750 | v2-highcpu-1 | 1024 | 0 | 0 | 1 | True | 11:52:42 + for file in "$1"/* 11:52:42 + '[' -f jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g-200g.cfg ']' 11:52:42 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g-200g.cfg 11:52:42 + export 'IMAGE_NAME=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713' 11:52:42 + IMAGE_NAME='ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713' 11:52:42 + openstack image list --property 'name=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713' 11:52:42 + grep active 11:52:46 | f8f5be2b-119e-460a-81c3-c0b10dd25c5f | ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713 | active | 11:52:46 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g-200g.cfg 11:52:46 + export HARDWARE_ID=v2-standard-2 11:52:46 + HARDWARE_ID=v2-standard-2 11:52:46 + openstack flavor list 11:52:46 + grep ' v2-standard-2 ' 11:52:48 | ac2c4d17-8d6f-4e3c-a9eb-57c155f0a949 | v2-standard-2 | 8192 | 0 | 0 | 2 | True | 11:52:48 + for file in "$1"/* 11:52:48 + '[' -f jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g.cfg ']' 11:52:48 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g.cfg 11:52:48 + export 'IMAGE_NAME=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713' 11:52:48 + IMAGE_NAME='ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713' 11:52:48 + openstack image list --property 'name=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713' 11:52:48 + grep active 11:52:51 | f8f5be2b-119e-460a-81c3-c0b10dd25c5f | ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713 | active | 11:52:51 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g.cfg 11:52:51 + export HARDWARE_ID=v2-standard-2 11:52:51 + HARDWARE_ID=v2-standard-2 11:52:51 + openstack flavor list 11:52:51 + grep ' v2-standard-2 ' 11:52:53 | ac2c4d17-8d6f-4e3c-a9eb-57c155f0a949 | v2-standard-2 | 8192 | 0 | 0 | 2 | True | 11:52:53 + for file in "$1"/* 11:52:53 + '[' -f jenkins-config/clouds/openstack/cattle/centos8-builder-1c-1g.cfg ']' 11:52:53 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos8-builder-1c-1g.cfg 11:52:53 + export 'IMAGE_NAME=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191' 11:52:53 + IMAGE_NAME='ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191' 11:52:53 + openstack image list --property 'name=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191' 11:52:53 + grep active 11:52:57 | b55d6504-d53f-4d4d-b0aa-82917f09b160 | ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191 | active | 11:52:57 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos8-builder-1c-1g.cfg 11:52:57 + export HARDWARE_ID=v2-highcpu-1 11:52:57 + HARDWARE_ID=v2-highcpu-1 11:52:57 + openstack flavor list 11:52:57 + grep ' v2-highcpu-1 ' 11:52:59 | c04abb7a-2b61-4ed3-8ce8-6c40ad9df750 | v2-highcpu-1 | 1024 | 0 | 0 | 1 | True | 11:52:59 + for file in "$1"/* 11:52:59 + '[' -f jenkins-config/clouds/openstack/cattle/centos8-builder-2c-2g.cfg ']' 11:52:59 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos8-builder-2c-2g.cfg 11:52:59 + export 'IMAGE_NAME=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191' 11:52:59 + IMAGE_NAME='ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191' 11:52:59 + openstack image list --property 'name=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191' 11:52:59 + grep active 11:53:02 | b55d6504-d53f-4d4d-b0aa-82917f09b160 | ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191 | active | 11:53:02 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos8-builder-2c-2g.cfg 11:53:02 + export HARDWARE_ID=v2-standard-2 11:53:02 + HARDWARE_ID=v2-standard-2 11:53:02 + openstack flavor list 11:53:02 + grep ' v2-standard-2 ' 11:53:04 | ac2c4d17-8d6f-4e3c-a9eb-57c155f0a949 | v2-standard-2 | 8192 | 0 | 0 | 2 | True | 11:53:04 + for file in "$1"/* 11:53:04 + '[' -f jenkins-config/clouds/openstack/cattle/cloud.cfg ']' 11:53:04 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/cloud.cfg 11:53:04 + export 'IMAGE_NAME=ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874' 11:53:04 + IMAGE_NAME='ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874' 11:53:04 + openstack image list --property 'name=ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874' 11:53:04 + grep active 11:53:08 | 343bd23c-ed30-4138-b918-89afcc7604b1 | ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874 | active | 11:53:08 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/cloud.cfg 11:53:08 + export HARDWARE_ID=v2-highcpu-1 11:53:08 + HARDWARE_ID=v2-highcpu-1 11:53:08 + openstack flavor list 11:53:08 + grep ' v2-highcpu-1 ' 11:53:10 | c04abb7a-2b61-4ed3-8ce8-6c40ad9df750 | v2-highcpu-1 | 1024 | 0 | 0 | 1 | True | 11:53:10 + for file in "$1"/* 11:53:10 + '[' -f jenkins-config/clouds/openstack/cattle/releasenotes ']' 11:53:10 + for file in "$1"/* 11:53:10 + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-2c-2g.cfg ']' 11:53:10 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-2c-2g.cfg 11:53:10 + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546' 11:53:10 + IMAGE_NAME='ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546' 11:53:10 + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546' 11:53:10 + grep active 11:53:14 | 5f051f05-de78-4696-a031-19f161e114c2 | ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546 | active | 11:53:14 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-2c-2g.cfg 11:53:14 + export HARDWARE_ID=v2-highcpu-2 11:53:14 + HARDWARE_ID=v2-highcpu-2 11:53:14 + openstack flavor list 11:53:14 + grep ' v2-highcpu-2 ' 11:53:16 | 03bdf34e-8905-46bc-a4b9-8dbf94b6e06d | v2-highcpu-2 | 2048 | 0 | 0 | 2 | True | 11:53:16 + for file in "$1"/* 11:53:16 + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-4c-4g.cfg ']' 11:53:16 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-4c-4g.cfg 11:53:16 + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749' 11:53:16 + IMAGE_NAME='ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749' 11:53:16 + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749' 11:53:16 + grep active 11:53:19 | df2201fe-3e7f-4b7a-9efe-dc672337afb0 | ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749 | active | 11:53:19 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-4c-4g.cfg 11:53:19 + export HARDWARE_ID=v2-highcpu-4 11:53:19 + HARDWARE_ID=v2-highcpu-4 11:53:19 + openstack flavor list 11:53:19 + grep ' v2-highcpu-4 ' 11:53:21 | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4 | 4096 | 0 | 0 | 4 | True | 11:53:21 + for file in "$1"/* 11:53:21 + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-2c-8g.cfg ']' 11:53:21 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-2c-8g.cfg 11:53:21 + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956' 11:53:21 + IMAGE_NAME='ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956' 11:53:21 + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956' 11:53:21 + grep active 11:53:24 | 363324d0-d934-4397-a96c-67f60045cedd | ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956 | active | 11:53:24 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-2c-8g.cfg 11:53:24 + export HARDWARE_ID=v2-highcpu-4 11:53:24 + HARDWARE_ID=v2-highcpu-4 11:53:24 + openstack flavor list 11:53:24 + grep ' v2-highcpu-4 ' 11:53:27 | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4 | 4096 | 0 | 0 | 4 | True | 11:53:27 + for file in "$1"/* 11:53:27 + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-4c-4g.cfg ']' 11:53:27 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-4c-4g.cfg 11:53:27 + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956' 11:53:27 + IMAGE_NAME='ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956' 11:53:27 + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956' 11:53:27 + grep active 11:53:30 | 363324d0-d934-4397-a96c-67f60045cedd | ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956 | active | 11:53:30 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-4c-4g.cfg 11:53:30 + export HARDWARE_ID=v2-highcpu-4 11:53:30 + HARDWARE_ID=v2-highcpu-4 11:53:30 + openstack flavor list 11:53:30 + grep ' v2-highcpu-4 ' 11:53:32 | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4 | 4096 | 0 | 0 | 4 | True | 11:53:32 + for file in "$1"/* 11:53:32 + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-2c-2g.cfg ']' 11:53:32 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-2c-2g.cfg 11:53:32 + export 'IMAGE_NAME=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263' 11:53:32 + IMAGE_NAME='ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263' 11:53:32 + openstack image list --property 'name=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263' 11:53:32 + grep active 11:53:36 | f515d236-25ce-4fb1-98d8-9043a9f9b0b6 | ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263 | active | 11:53:36 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-2c-2g.cfg 11:53:36 + export HARDWARE_ID=v2-highcpu-2 11:53:36 + HARDWARE_ID=v2-highcpu-2 11:53:36 + grep ' v2-highcpu-2 ' 11:53:36 + openstack flavor list 11:53:38 | 03bdf34e-8905-46bc-a4b9-8dbf94b6e06d | v2-highcpu-2 | 2048 | 0 | 0 | 2 | True | 11:53:38 + for file in "$1"/* 11:53:38 + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-4c-4g.cfg ']' 11:53:38 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-4c-4g.cfg 11:53:38 + export 'IMAGE_NAME=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263' 11:53:38 + IMAGE_NAME='ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263' 11:53:38 + openstack image list --property 'name=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263' 11:53:38 + grep active 11:53:41 | f515d236-25ce-4fb1-98d8-9043a9f9b0b6 | ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263 | active | 11:53:41 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-4c-4g.cfg 11:53:41 + export HARDWARE_ID=v2-highcpu-4 11:53:41 + HARDWARE_ID=v2-highcpu-4 11:53:41 + openstack flavor list 11:53:41 + grep ' v2-highcpu-4 ' 11:53:43 | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4 | 4096 | 0 | 0 | 4 | True | 11:53:43 + for file in "$1"/* 11:53:43 + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2004-devstack-4c-16g.cfg ']' 11:53:43 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2004-devstack-4c-16g.cfg 11:53:43 + export 'IMAGE_NAME=ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255' 11:53:43 + IMAGE_NAME='ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255' 11:53:43 + openstack image list --property 'name=ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255' 11:53:43 + grep active 11:53:47 | c962a012-598c-4b9f-a5a0-a5e2cfbaba77 | ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255 | active | 11:53:47 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2004-devstack-4c-16g.cfg 11:53:47 + export HARDWARE_ID=v3-standard-4 11:53:47 + HARDWARE_ID=v3-standard-4 11:53:47 + openstack flavor list 11:53:47 + grep ' v3-standard-4 ' 11:53:49 | 2aff8c4a-fb90-41e1-a1df-e010e325b88d | v3-standard-4 | 16384 | 80 | 0 | 4 | True | 11:53:49 + for file in "$1"/* 11:53:49 + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2204-devstack-4c-16g.cfg ']' 11:53:49 ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2204-devstack-4c-16g.cfg 11:53:49 + export 'IMAGE_NAME=ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118' 11:53:49 + IMAGE_NAME='ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118' 11:53:49 + openstack image list --property 'name=ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118' 11:53:49 + grep active 11:53:52 | a6f6b7c5-9e94-4781-8f55-24b20e6a598f | ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118 | active | 11:53:52 ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2204-devstack-4c-16g.cfg 11:53:52 + export HARDWARE_ID=v3-standard-4 11:53:52 + HARDWARE_ID=v3-standard-4 11:53:52 + openstack flavor list 11:53:52 + grep ' v3-standard-4 ' 11:53:54 | 2aff8c4a-fb90-41e1-a1df-e010e325b88d | v3-standard-4 | 16384 | 80 | 0 | 4 | True | 11:53:54 + false 11:53:54 $ ssh-agent -k 11:53:54 unset SSH_AUTH_SOCK; 11:53:54 unset SSH_AGENT_PID; 11:53:54 echo Agent pid 5160 killed; 11:53:54 [ssh-agent] Stopped. 11:53:55 [PostBuildScript] - [INFO] Executing post build scripts. 11:53:55 [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins16312782682003814639.sh 11:53:55 ---> sysstat.sh 11:53:56 [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins9730485337267929434.sh 11:53:56 ---> package-listing.sh 11:53:56 ++ facter osfamily 11:53:56 ++ tr '[:upper:]' '[:lower:]' 11:53:56 + OS_FAMILY=redhat 11:53:56 + workspace=/w/workspace/ci-management-jenkins-cfg-verify 11:53:56 + START_PACKAGES=/tmp/packages_start.txt 11:53:56 + END_PACKAGES=/tmp/packages_end.txt 11:53:56 + DIFF_PACKAGES=/tmp/packages_diff.txt 11:53:56 + PACKAGES=/tmp/packages_start.txt 11:53:56 + '[' /w/workspace/ci-management-jenkins-cfg-verify ']' 11:53:56 + PACKAGES=/tmp/packages_end.txt 11:53:56 + case "${OS_FAMILY}" in 11:53:56 + rpm -qa 11:53:56 + sort 11:54:04 + '[' -f /tmp/packages_start.txt ']' 11:54:04 + '[' -f /tmp/packages_end.txt ']' 11:54:04 + diff /tmp/packages_start.txt /tmp/packages_end.txt 11:54:04 + '[' /w/workspace/ci-management-jenkins-cfg-verify ']' 11:54:04 + mkdir -p /w/workspace/ci-management-jenkins-cfg-verify/archives/ 11:54:04 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-jenkins-cfg-verify/archives/ 11:54:04 [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins7332384122083068757.sh 11:54:04 ---> capture-instance-metadata.sh 11:54:04 Setup pyenv: 11:54:04 system 11:54:04 3.8.13 11:54:04 3.9.13 11:54:04 * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version) 11:54:04 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-XPWL from file:/tmp/.os_lf_venv 11:54:05 lf-activate-venv(): INFO: Installing: lftools 11:54:15 lf-activate-venv(): INFO: Adding /tmp/venv-XPWL/bin to PATH 11:54:15 INFO: Running in OpenStack, capturing instance metadata 11:54:16 [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins8391626300186291644.sh 11:54:16 provisioning config files... 11:54:16 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-jenkins-cfg-verify@tmp/config16348428132889574997tmp 11:54:16 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 11:54:16 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 11:54:16 [EnvInject] - Injecting environment variables from a build step. 11:54:16 [EnvInject] - Injecting as environment variables the properties content 11:54:16 SERVER_ID=logs 11:54:16 11:54:16 [EnvInject] - Variables injected successfully. 11:54:16 [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins9931777152292002691.sh 11:54:16 ---> create-netrc.sh 11:54:17 [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins17760900867071256881.sh 11:54:17 ---> python-tools-install.sh 11:54:17 Setup pyenv: 11:54:17 system 11:54:17 3.8.13 11:54:17 3.9.13 11:54:17 * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version) 11:54:17 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-XPWL from file:/tmp/.os_lf_venv 11:54:18 lf-activate-venv(): INFO: Installing: lftools 11:54:27 lf-activate-venv(): INFO: Adding /tmp/venv-XPWL/bin to PATH 11:54:27 [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins1250021513093806995.sh 11:54:27 ---> sudo-logs.sh 11:54:27 Archiving 'sudo' log.. 11:54:27 [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins14718626332499234556.sh 11:54:27 ---> job-cost.sh 11:54:27 Setup pyenv: 11:54:28 system 11:54:28 3.8.13 11:54:28 3.9.13 11:54:28 * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version) 11:54:28 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-XPWL from file:/tmp/.os_lf_venv 11:54:29 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 11:54:33 lf-activate-venv(): INFO: Adding /tmp/venv-XPWL/bin to PATH 11:54:33 INFO: No Stack... 11:54:34 INFO: Retrieving Pricing Info for: v2-highcpu-1 11:54:34 INFO: Archiving Costs 11:54:34 [ci-management-jenkins-cfg-verify] $ /bin/bash -l /tmp/jenkins9266925552534188841.sh 11:54:34 ---> logs-deploy.sh 11:54:34 Setup pyenv: 11:54:34 system 11:54:34 3.8.13 11:54:34 3.9.13 11:54:34 * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version) 11:54:34 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-XPWL from file:/tmp/.os_lf_venv 11:54:35 lf-activate-venv(): INFO: Installing: lftools 11:54:44 lf-activate-venv(): INFO: Adding /tmp/venv-XPWL/bin to PATH 11:54:44 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-jenkins-cfg-verify/222 11:54:44 INFO: archiving workspace using pattern(s): 11:54:47 Archives upload complete. 11:54:47 INFO: archiving logs to Nexus 11:54:48 ---> uname -a: 11:54:48 Linux prd-centos8-builder-1c-1g-3744.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 11:54:48 11:54:48 11:54:48 ---> lscpu: 11:54:48 Architecture: x86_64 11:54:48 CPU op-mode(s): 32-bit, 64-bit 11:54:48 Byte Order: Little Endian 11:54:48 CPU(s): 1 11:54:48 On-line CPU(s) list: 0 11:54:48 Thread(s) per core: 1 11:54:48 Core(s) per socket: 1 11:54:48 Socket(s): 1 11:54:48 NUMA node(s): 1 11:54:48 Vendor ID: AuthenticAMD 11:54:48 CPU family: 23 11:54:48 Model: 49 11:54:48 Model name: AMD EPYC-Rome Processor 11:54:48 Stepping: 0 11:54:48 CPU MHz: 2800.000 11:54:48 BogoMIPS: 5600.00 11:54:48 Virtualization: AMD-V 11:54:48 Hypervisor vendor: KVM 11:54:48 Virtualization type: full 11:54:48 L1d cache: 32K 11:54:48 L1i cache: 32K 11:54:48 L2 cache: 512K 11:54:48 L3 cache: 16384K 11:54:48 NUMA node0 CPU(s): 0 11:54:48 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 11:54:48 11:54:48 11:54:48 ---> nproc: 11:54:48 1 11:54:48 11:54:48 11:54:48 ---> df -h: 11:54:48 Filesystem Size Used Avail Use% Mounted on 11:54:48 devtmpfs 329M 0 329M 0% /dev 11:54:48 tmpfs 386M 0 386M 0% /dev/shm 11:54:48 tmpfs 386M 11M 376M 3% /run 11:54:48 tmpfs 386M 0 386M 0% /sys/fs/cgroup 11:54:48 /dev/vda1 20G 9.0G 12G 45% / 11:54:48 tmpfs 78M 0 78M 0% /run/user/1001 11:54:48 11:54:48 11:54:48 ---> free -m: 11:54:48 total used free shared buff/cache available 11:54:48 Mem: 770 329 50 5 390 309 11:54:48 Swap: 1023 22 1001 11:54:48 11:54:48 11:54:48 ---> ip addr: 11:54:48 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 11:54:48 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 11:54:48 inet 127.0.0.1/8 scope host lo 11:54:48 valid_lft forever preferred_lft forever 11:54:48 inet6 ::1/128 scope host 11:54:48 valid_lft forever preferred_lft forever 11:54:48 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 11:54:48 link/ether fa:16:3e:83:27:a4 brd ff:ff:ff:ff:ff:ff 11:54:48 altname enp0s3 11:54:48 altname ens3 11:54:48 inet 10.32.6.96/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 11:54:48 valid_lft 86153sec preferred_lft 86153sec 11:54:48 inet6 fe80::f816:3eff:fe83:27a4/64 scope link 11:54:48 valid_lft forever preferred_lft forever 11:54:48 11:54:48 11:54:48 ---> sar -b -r -n DEV: 11:54:48 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 08/30/2024 _x86_64_ (1 CPU) 11:54:48 11:54:48 11:50:36 LINUX RESTART (1 CPU) 11:54:48 11:54:48 11:51:01 AM tps rtps wtps bread/s bwrtn/s 11:54:48 11:52:01 AM 241.33 107.50 133.83 8410.51 44709.76 11:54:48 11:53:01 AM 122.51 31.26 91.25 3440.99 10107.96 11:54:48 11:54:01 AM 72.55 63.52 9.03 5962.40 520.38 11:54:48 Average: 145.48 67.45 78.04 5939.35 18451.66 11:54:48 11:54:48 11:51:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 11:54:48 11:52:01 AM 58580 285948 730628 92.58 1148 299628 531344 28.91 128656 449576 10420 11:54:48 11:53:01 AM 81396 329920 707812 89.69 64 315636 477616 25.99 116928 420780 5560 11:54:48 11:54:01 AM 54224 352988 734984 93.13 64 365052 462440 25.16 102904 462244 44 11:54:48 Average: 64733 322952 724475 91.80 425 326772 490467 26.69 116163 444200 5341 11:54:48 11:54:48 11:51:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 11:54:48 11:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 11:54:48 11:52:01 AM eth0 251.43 136.49 1489.44 60.30 0.00 0.00 0.00 0.00 11:54:48 11:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 11:54:48 11:53:01 AM eth0 35.54 31.04 253.70 6.37 0.00 0.00 0.00 0.00 11:54:48 11:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 11:54:48 11:54:01 AM eth0 33.84 25.00 61.32 5.49 0.00 0.00 0.00 0.00 11:54:48 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 11:54:48 Average: eth0 106.98 64.20 601.71 24.07 0.00 0.00 0.00 0.00 11:54:48 11:54:48 11:54:48 ---> sar -P ALL: 11:54:48 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 08/30/2024 _x86_64_ (1 CPU) 11:54:48 11:54:48 11:50:36 LINUX RESTART (1 CPU) 11:54:48 11:54:48 11:51:01 AM CPU %user %nice %system %iowait %steal %idle 11:54:48 11:52:01 AM all 64.58 0.05 14.36 7.90 0.12 12.99 11:54:48 11:52:01 AM 0 64.58 0.05 14.36 7.90 0.12 12.99 11:54:48 11:53:01 AM all 55.95 0.00 9.40 3.62 0.10 30.92 11:54:48 11:53:01 AM 0 55.95 0.00 9.40 3.62 0.10 30.92 11:54:48 11:54:01 AM all 38.17 0.00 4.96 7.43 0.10 49.34 11:54:48 11:54:01 AM 0 38.17 0.00 4.96 7.43 0.10 49.34 11:54:48 Average: all 52.91 0.02 9.58 6.32 0.11 31.07 11:54:48 Average: 0 52.91 0.02 9.58 6.32 0.11 31.07 11:54:48 11:54:48 11:54:48