03:44:33 Triggered by Gerrit: https://gerrit.o-ran-sc.org/r/c/pti/o2/+/12578 03:44:33 Running as SYSTEM 03:44:33 [EnvInject] - Loading node environment variables. 03:44:33 Building remotely on prd-centos7-docker-2c-8g-3270 (centos7-docker-2c-8g) in workspace /w/workspace/pti-o2-release-merge-master 03:44:33 [ssh-agent] Looking for ssh-agent implementation... 03:44:33 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 03:44:33 $ ssh-agent 03:44:33 SSH_AUTH_SOCK=/tmp/ssh-FyoHwTvrsIWO/agent.8260 03:44:33 SSH_AGENT_PID=8262 03:44:33 [ssh-agent] Started. 03:44:33 Running ssh-add (command line suppressed) 03:44:33 Identity added: /w/workspace/pti-o2-release-merge-master@tmp/private_key_7436575788551133605.key (/w/workspace/pti-o2-release-merge-master@tmp/private_key_7436575788551133605.key) 03:44:33 [ssh-agent] Using credentials jenkins-release (jenkins-release) 03:44:33 The recommended git tool is: NONE 03:44:35 using credential jenkins 03:44:35 Wiping out workspace first. 03:44:35 Cloning the remote Git repository 03:44:35 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/pti/o2 03:44:35 > git init /w/workspace/pti-o2-release-merge-master # timeout=10 03:44:35 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/pti/o2 03:44:35 > git --version # timeout=10 03:44:35 > git --version # 'git version 2.36.6' 03:44:35 using GIT_SSH to set credentials jenkins 03:44:35 [INFO] Currently running in a labeled security context 03:44:35 [INFO] Currently SELinux is 'enforcing' on the host 03:44:35 > /usr/bin/chcon --type=ssh_home_t /w/workspace/pti-o2-release-merge-master@tmp/jenkins-gitclient-ssh2122453576057868610.key 03:44:35 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/pti/o2 +refs/heads/*:refs/remotes/origin/* # timeout=10 03:44:36 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/pti/o2 # timeout=10 03:44:36 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 03:44:36 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/pti/o2 # timeout=10 03:44:36 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/pti/o2 03:44:36 using GIT_SSH to set credentials jenkins 03:44:36 [INFO] Currently running in a labeled security context 03:44:36 [INFO] Currently SELinux is 'enforcing' on the host 03:44:36 > /usr/bin/chcon --type=ssh_home_t /w/workspace/pti-o2-release-merge-master@tmp/jenkins-gitclient-ssh14101369837833745569.key 03:44:36 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/pti/o2 refs/changes/78/12578/3 # timeout=10 03:44:37 > git rev-parse f037dc6efe1d1bd68d2b01b229c15d5b6db00f9c^{commit} # timeout=10 03:44:37 Checking out Revision f037dc6efe1d1bd68d2b01b229c15d5b6db00f9c (refs/changes/78/12578/3) 03:44:37 > git config core.sparsecheckout # timeout=10 03:44:37 > git checkout -f f037dc6efe1d1bd68d2b01b229c15d5b6db00f9c # timeout=10 03:44:37 Commit message: "Redo release the 2.0.3 image" 03:44:37 First time build. Skipping changelog. 03:44:37 Run condition [Regular expression match] enabling prebuild for step [BuilderChain] 03:44:37 provisioning config files... 03:44:37 copy managed file [npmrc] to file:/home/jenkins/.npmrc 03:44:37 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 03:44:37 $ ssh-agent -k 03:44:37 unset SSH_AUTH_SOCK; 03:44:37 unset SSH_AGENT_PID; 03:44:37 echo Agent pid 8262 killed; 03:44:37 [ssh-agent] Stopped. 03:44:37 ERROR: Could not find credentials entry with ID 'cosign-private-key' 03:44:37 [PostBuildScript] - [INFO] Executing post build scripts. 03:44:37 [pti-o2-release-merge-master] $ /bin/bash /tmp/jenkins3360209054991039785.sh 03:44:37 ---> sysstat.sh 03:44:37 [pti-o2-release-merge-master] $ /bin/bash /tmp/jenkins18228635400404927820.sh 03:44:37 ---> package-listing.sh 03:44:37 ++ facter osfamily 03:44:37 ++ tr '[:upper:]' '[:lower:]' 03:44:38 + OS_FAMILY=redhat 03:44:38 + workspace=/w/workspace/pti-o2-release-merge-master 03:44:38 + START_PACKAGES=/tmp/packages_start.txt 03:44:38 + END_PACKAGES=/tmp/packages_end.txt 03:44:38 + DIFF_PACKAGES=/tmp/packages_diff.txt 03:44:38 + PACKAGES=/tmp/packages_start.txt 03:44:38 + '[' /w/workspace/pti-o2-release-merge-master ']' 03:44:38 + PACKAGES=/tmp/packages_end.txt 03:44:38 + case "${OS_FAMILY}" in 03:44:38 + sort 03:44:38 + rpm -qa 03:44:38 + '[' -f /tmp/packages_start.txt ']' 03:44:38 + '[' -f /tmp/packages_end.txt ']' 03:44:38 + diff /tmp/packages_start.txt /tmp/packages_end.txt 03:44:38 + '[' /w/workspace/pti-o2-release-merge-master ']' 03:44:38 + mkdir -p /w/workspace/pti-o2-release-merge-master/archives/ 03:44:38 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/pti-o2-release-merge-master/archives/ 03:44:38 [pti-o2-release-merge-master] $ /bin/bash /tmp/jenkins5045581727662930786.sh 03:44:38 ---> capture-instance-metadata.sh 03:44:38 Setup pyenv: 03:44:39 system 03:44:39 * 3.8.13 (set by /opt/pyenv/version) 03:44:39 * 3.9.13 (set by /opt/pyenv/version) 03:44:43 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-VJJR 03:44:43 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 03:44:46 lf-activate-venv(): INFO: Installing: lftools 03:45:16 lf-activate-venv(): INFO: Adding /tmp/venv-VJJR/bin to PATH 03:45:16 INFO: Running in OpenStack, capturing instance metadata 03:45:16 [pti-o2-release-merge-master] $ /bin/bash /tmp/jenkins7286879251204321306.sh 03:45:16 provisioning config files... 03:45:16 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/pti-o2-release-merge-master@tmp/config4146502007557758569tmp 03:45:16 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 03:45:16 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 03:45:16 [EnvInject] - Injecting environment variables from a build step. 03:45:16 [EnvInject] - Injecting as environment variables the properties content 03:45:16 SERVER_ID=logs 03:45:16 03:45:16 [EnvInject] - Variables injected successfully. 03:45:16 [pti-o2-release-merge-master] $ /bin/bash /tmp/jenkins13595418685094947750.sh 03:45:16 ---> create-netrc.sh 03:45:16 [pti-o2-release-merge-master] $ /bin/bash /tmp/jenkins16634484500218937603.sh 03:45:16 ---> python-tools-install.sh 03:45:16 Setup pyenv: 03:45:16 system 03:45:16 3.8.13 03:45:16 * 3.9.13 (set by /w/workspace/pti-o2-release-merge-master/.python-version) 03:45:16 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-VJJR from file:/tmp/.os_lf_venv 03:45:17 lf-activate-venv(): INFO: Installing: lftools 03:45:27 lf-activate-venv(): INFO: Adding /tmp/venv-VJJR/bin to PATH 03:45:27 Generating Requirements File 03:46:00 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 03:46:00 lftools 0.37.9 requires openstacksdk>=2.1.0, but you have openstacksdk 0.62.0 which is incompatible. 03:46:01 Python 3.9.13 03:46:01 pip 24.0 from /tmp/venv-VJJR/lib/python3.9/site-packages/pip (python 3.9) 03:46:02 appdirs==1.4.4 03:46:02 argcomplete==3.2.2 03:46:02 aspy.yaml==1.3.0 03:46:02 attrs==23.2.0 03:46:02 autopage==0.5.2 03:46:02 beautifulsoup4==4.12.3 03:46:02 boto3==1.34.53 03:46:02 botocore==1.34.53 03:46:02 bs4==0.0.2 03:46:02 cachetools==5.3.3 03:46:02 certifi==2024.2.2 03:46:02 cffi==1.16.0 03:46:02 cfgv==3.4.0 03:46:02 chardet==5.2.0 03:46:02 charset-normalizer==3.3.2 03:46:02 click==8.1.7 03:46:02 cliff==4.6.0 03:46:02 cmd2==2.4.3 03:46:02 cryptography==3.3.2 03:46:02 debtcollector==3.0.0 03:46:02 decorator==5.1.1 03:46:02 defusedxml==0.7.1 03:46:02 Deprecated==1.2.14 03:46:02 distlib==0.3.8 03:46:02 dnspython==2.6.1 03:46:02 docker==4.2.2 03:46:02 dogpile.cache==1.3.2 03:46:02 email_validator==2.1.1 03:46:02 filelock==3.13.1 03:46:02 future==1.0.0 03:46:02 gitdb==4.0.11 03:46:02 GitPython==3.1.42 03:46:02 google-auth==2.28.1 03:46:02 httplib2==0.22.0 03:46:02 identify==2.5.35 03:46:02 idna==3.6 03:46:02 importlib-metadata==7.0.1 03:46:02 importlib-resources==1.5.0 03:46:02 iso8601==2.1.0 03:46:02 Jinja2==3.1.3 03:46:02 jmespath==1.0.1 03:46:02 jsonpatch==1.33 03:46:02 jsonpointer==2.4 03:46:02 jsonschema==4.21.1 03:46:02 jsonschema-specifications==2023.12.1 03:46:02 keystoneauth1==5.6.0 03:46:02 kubernetes==29.0.0 03:46:02 lftools==0.37.9 03:46:02 lxml==5.1.0 03:46:02 MarkupSafe==2.1.5 03:46:02 msgpack==1.0.7 03:46:02 multi_key_dict==2.0.3 03:46:02 munch==4.0.0 03:46:02 netaddr==1.2.1 03:46:02 netifaces==0.11.0 03:46:02 niet==1.4.2 03:46:02 nodeenv==1.8.0 03:46:02 oauth2client==4.1.3 03:46:02 oauthlib==3.2.2 03:46:02 openstacksdk==0.62.0 03:46:02 os-client-config==2.1.0 03:46:02 os-service-types==1.7.0 03:46:02 osc-lib==3.0.1 03:46:02 oslo.config==9.4.0 03:46:02 oslo.context==5.5.0 03:46:02 oslo.i18n==6.3.0 03:46:02 oslo.log==5.5.0 03:46:02 oslo.serialization==5.4.0 03:46:02 oslo.utils==7.1.0 03:46:02 packaging==23.2 03:46:02 pbr==6.0.0 03:46:02 platformdirs==4.2.0 03:46:02 prettytable==3.10.0 03:46:02 pyasn1==0.5.1 03:46:02 pyasn1-modules==0.3.0 03:46:02 pycparser==2.21 03:46:02 pygerrit2==2.0.15 03:46:02 PyGithub==2.2.0 03:46:02 pyinotify==0.9.6 03:46:02 PyJWT==2.8.0 03:46:02 PyNaCl==1.5.0 03:46:02 pyparsing==2.4.7 03:46:02 pyperclip==1.8.2 03:46:02 pyrsistent==0.20.0 03:46:02 python-cinderclient==9.4.0 03:46:02 python-dateutil==2.8.2 03:46:02 python-heatclient==3.4.0 03:46:02 python-jenkins==1.8.2 03:46:02 python-keystoneclient==5.3.0 03:46:02 python-magnumclient==4.3.0 03:46:02 python-novaclient==18.4.0 03:46:02 python-openstackclient==6.0.1 03:46:02 python-swiftclient==4.5.0 03:46:02 PyYAML==6.0.1 03:46:02 referencing==0.33.0 03:46:02 requests==2.31.0 03:46:02 requests-oauthlib==1.3.1 03:46:02 requestsexceptions==1.4.0 03:46:02 rfc3986==2.0.0 03:46:02 rpds-py==0.18.0 03:46:02 rsa==4.9 03:46:02 ruamel.yaml==0.18.6 03:46:02 ruamel.yaml.clib==0.2.8 03:46:02 s3transfer==0.10.0 03:46:02 simplejson==3.19.2 03:46:02 six==1.16.0 03:46:02 smmap==5.0.1 03:46:02 soupsieve==2.5 03:46:02 stevedore==5.2.0 03:46:02 tabulate==0.9.0 03:46:02 toml==0.10.2 03:46:02 tomlkit==0.12.4 03:46:02 tqdm==4.66.2 03:46:02 typing_extensions==4.10.0 03:46:02 tzdata==2024.1 03:46:02 urllib3==1.26.18 03:46:02 virtualenv==20.25.1 03:46:02 wcwidth==0.2.13 03:46:02 websocket-client==1.7.0 03:46:02 wrapt==1.16.0 03:46:02 xdg==6.0.0 03:46:02 xmltodict==0.13.0 03:46:02 yq==3.2.3 03:46:02 zipp==3.17.0 03:46:02 [pti-o2-release-merge-master] $ /bin/bash /tmp/jenkins9119258718532699620.sh 03:46:02 ---> sudo-logs.sh 03:46:02 Archiving 'sudo' log.. 03:46:02 [pti-o2-release-merge-master] $ /bin/bash /tmp/jenkins14048737623517731894.sh 03:46:02 ---> job-cost.sh 03:46:02 Setup pyenv: 03:46:02 system 03:46:02 3.8.13 03:46:02 * 3.9.13 (set by /w/workspace/pti-o2-release-merge-master/.python-version) 03:46:02 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-VJJR from file:/tmp/.os_lf_venv 03:46:04 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 03:46:13 lf-activate-venv(): INFO: Adding /tmp/venv-VJJR/bin to PATH 03:46:13 INFO: No Stack... 03:46:13 INFO: Retrieving Pricing Info for: v2-standard-2 03:46:14 INFO: Archiving Costs 03:46:14 [pti-o2-release-merge-master] $ /bin/bash -l /tmp/jenkins9614357975970061912.sh 03:46:14 ---> logs-deploy.sh 03:46:14 Setup pyenv: 03:46:14 system 03:46:14 3.8.13 03:46:14 * 3.9.13 (set by /w/workspace/pti-o2-release-merge-master/.python-version) 03:46:14 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-VJJR from file:/tmp/.os_lf_venv 03:46:15 lf-activate-venv(): INFO: Installing: lftools 03:46:26 lf-activate-venv(): INFO: Adding /tmp/venv-VJJR/bin to PATH 03:46:26 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/pti-o2-release-merge-master/2 03:46:26 INFO: archiving workspace using pattern(s): 03:46:28 Archives upload complete. 03:46:28 INFO: archiving logs to Nexus 03:46:29 ---> uname -a: 03:46:29 Linux prd-centos7-docker-2c-8g-3270.novalocal 3.10.0-1160.108.1.el7.x86_64 #1 SMP Thu Jan 25 16:17:31 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 03:46:29 03:46:29 03:46:29 ---> lscpu: 03:46:29 Architecture: x86_64 03:46:29 CPU op-mode(s): 32-bit, 64-bit 03:46:29 Byte Order: Little Endian 03:46:29 CPU(s): 2 03:46:29 On-line CPU(s) list: 0,1 03:46:29 Thread(s) per core: 1 03:46:29 Core(s) per socket: 1 03:46:29 Socket(s): 2 03:46:29 NUMA node(s): 1 03:46:29 Vendor ID: AuthenticAMD 03:46:29 CPU family: 23 03:46:29 Model: 49 03:46:29 Model name: AMD EPYC-Rome Processor 03:46:29 Stepping: 0 03:46:29 CPU MHz: 2800.000 03:46:29 BogoMIPS: 5600.00 03:46:29 Virtualization: AMD-V 03:46:29 Hypervisor vendor: KVM 03:46:29 Virtualization type: full 03:46:29 L1d cache: 32K 03:46:29 L1i cache: 32K 03:46:29 L2 cache: 512K 03:46:29 L3 cache: 16384K 03:46:29 NUMA node0 CPU(s): 0,1 03:46:29 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm art rep_good nopl extd_apicid eagerfpu pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd rsb_ctxsw ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr arat npt nrip_save umip spec_ctrl intel_stibp arch_capabilities 03:46:29 03:46:29 03:46:29 ---> nproc: 03:46:29 2 03:46:29 03:46:29 03:46:29 ---> df -h: 03:46:29 Filesystem Size Used Avail Use% Mounted on 03:46:29 devtmpfs 3.8G 0 3.8G 0% /dev 03:46:29 tmpfs 3.9G 0 3.9G 0% /dev/shm 03:46:29 tmpfs 3.9G 17M 3.9G 1% /run 03:46:29 tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup 03:46:29 /dev/vda1 20G 7.2G 13G 36% / 03:46:29 tmpfs 783M 0 783M 0% /run/user/1001 03:46:29 03:46:29 03:46:29 ---> free -m: 03:46:29 total used free shared buff/cache available 03:46:29 Mem: 7821 533 5286 16 2001 7005 03:46:29 Swap: 1023 0 1023 03:46:29 03:46:29 03:46:29 ---> ip addr: 03:46:29 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 03:46:29 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 03:46:29 inet 127.0.0.1/8 scope host lo 03:46:29 valid_lft forever preferred_lft forever 03:46:29 inet6 ::1/128 scope host 03:46:29 valid_lft forever preferred_lft forever 03:46:29 2: eth0: mtu 1450 qdisc pfifo_fast state UP group default qlen 1000 03:46:29 link/ether fa:16:3e:48:b0:ea brd ff:ff:ff:ff:ff:ff 03:46:29 inet 10.32.7.18/23 brd 10.32.7.255 scope global dynamic eth0 03:46:29 valid_lft 86262sec preferred_lft 86262sec 03:46:29 inet6 fe80::f816:3eff:fe48:b0ea/64 scope link 03:46:29 valid_lft forever preferred_lft forever 03:46:29 3: docker0: mtu 1458 qdisc noqueue state DOWN group default 03:46:29 link/ether 02:42:95:19:e2:f5 brd ff:ff:ff:ff:ff:ff 03:46:29 inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 03:46:29 valid_lft forever preferred_lft forever 03:46:29 03:46:29 03:46:29 ---> sar -b -r -n DEV: 03:46:29 Linux 3.10.0-1160.108.1.el7.x86_64 (centos-7-docker-68ea08a2-fc71-4092-b095-5d2ce07d1279.novalocal) 03/01/2024 _x86_64_ (2 CPU) 03:46:29 03:46:29 03:44:04 AM LINUX RESTART 03:46:29 03:46:29 03:45:02 AM tps rtps wtps bread/s bwrtn/s 03:46:29 03:46:01 AM 85.50 0.37 85.13 79.13 8997.95 03:46:29 Average: 85.50 0.37 85.13 79.13 8997.95 03:46:29 03:46:29 03:45:02 AM kbmemfree kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 03:46:29 03:46:01 AM 5401368 2607360 32.56 2088 1935636 918704 10.14 694712 1615280 103984 03:46:29 Average: 5401368 2607360 32.56 2088 1935636 918704 10.14 694712 1615280 103984 03:46:29 03:46:29 03:45:02 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s 03:46:29 03:46:01 AM eth0 41.92 42.45 414.23 7.45 0.00 0.00 0.00 03:46:29 03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:29 03:46:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:29 Average: eth0 41.92 42.45 414.23 7.45 0.00 0.00 0.00 03:46:29 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:29 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:29 03:46:29 03:46:29 ---> sar -P ALL: 03:46:29 Linux 3.10.0-1160.108.1.el7.x86_64 (centos-7-docker-68ea08a2-fc71-4092-b095-5d2ce07d1279.novalocal) 03/01/2024 _x86_64_ (2 CPU) 03:46:29 03:46:29 03:44:04 AM LINUX RESTART 03:46:29 03:46:29 03:45:02 AM CPU %user %nice %system %iowait %steal %idle 03:46:29 03:46:01 AM all 36.37 0.00 2.88 0.91 0.09 59.75 03:46:29 03:46:01 AM 0 20.12 0.00 1.79 0.26 0.09 77.75 03:46:29 03:46:01 AM 1 53.23 0.00 4.04 1.60 0.11 41.03 03:46:29 Average: all 36.37 0.00 2.88 0.91 0.09 59.75 03:46:29 Average: 0 20.12 0.00 1.79 0.26 0.09 77.75 03:46:29 Average: 1 53.23 0.00 4.04 1.60 0.11 41.03 03:46:29 03:46:29 03:46:29