2024-06-13 11:27:01,248 | kfadapter_conf.py 103 get_kfhostname() | ERROR | Getting hostname 2024-06-13 11:27:01,284 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,286 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,286 | kfadapter_kfconnect.py 85 get_kf_experiment_details() | DEBUG | Get Experiment details ai-server 2024-06-13 11:27:01,288 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,289 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,291 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,292 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,294 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,296 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,298 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,299 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,302 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,304 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,306 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,307 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,309 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,310 | kfadapter_kfconnect.py 264 run_kf_pipeline() | DEBUG | run_kf_pipeline Entered 2024-06-13 11:27:01,310 | kfadapter_kfconnect.py 270 run_kf_pipeline() | DEBUG | run_kf_pipeline Exited 2024-06-13 11:27:01,312 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,312 | kfadapter_kfconnect.py 85 get_kf_experiment_details() | DEBUG | Get Experiment details ai-server 2024-06-13 11:27:01,313 | kfadapter_kfconnect.py 89 get_kf_experiment_details() | ERROR | Either experiment_id or experiment_name is required 2024-06-13 11:27:01,314 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,325 | kfadapter_main.py 500 kf_run() | ERROR | Method not supported yet 2024-06-13 11:27:01,325 | kfadapter_main.py 510 kf_run() | ERROR | Exception from KubeFlow in run 2024-06-13 11:27:01,325 | kfadapter_main.py 511 kf_run() | ERROR | 2024-06-13 11:27:01,330 | kfadapter_main.py 352 run_pipeline() | DEBUG | run_pipeline for job_name 2024-06-13 11:27:01,331 | kfadapter_main.py 358 run_pipeline() | DEBUG | {'arguments': {'param-name2': 'param-value2', 'param-name3': 'param-value3'}, 'pipeline_name': 'pipeline-name', 'pipeline_version': '2.0.0', 'experiment_name': 'exp-name'} 2024-06-13 11:27:01,331 | kfadapter_main.py 373 run_pipeline() | DEBUG | {'created_at': None, 'description': None, 'id': 'exp-id', 'name': 'exp-name', 'resource_references': None, 'storage_state': None} 2024-06-13 11:27:01,332 | kfadapter_main.py 378 run_pipeline() | DEBUG | Pipeline ID = pipeline-id 2024-06-13 11:27:01,332 | kfadapter_main.py 381 run_pipeline() | DEBUG | Getting pipeline desc 2024-06-13 11:27:01,332 | kfadapter_main.py 384 run_pipeline() | DEBUG | {'created_at': None, 'default_version': {'code_source_url': None, 'created_at': None, 'description': None, 'id': None, 'name': None, 'package_url': None, 'parameters': [{'name': 'param-name2', 'value': 'param-value2'}, {'name': 'param-name3', 'value': 'param-value3'}], 'resource_references': None}, 'description': 'pipeline-description', 'error': None, 'id': 'pipeline-name', 'name': 'pipeline-id', 'parameters': [{'name': 'param-name0', 'value': 'param-value0'}, {'name': 'param-name1', 'value': 'param-value1'}], 'resource_references': None, 'url': None} 2024-06-13 11:27:01,335 | kfadapter_main.py 387 run_pipeline() | DEBUG | Arguments provided dict_keys(['param-name2', 'param-name3']) 2024-06-13 11:27:01,336 | kfadapter_main.py 388 run_pipeline() | DEBUG | Arguments in pipeline dict_keys(['param-name2', 'param-name3']) 2024-06-13 11:27:01,336 | kfadapter_main.py 396 run_pipeline() | DEBUG | Running pipeline 2024-06-13 11:27:01,336 | kfadapter_main.py 398 run_pipeline() | DEBUG | Run ID = run-id 2024-06-13 11:27:01,342 | kfadapter_main.py 86 get_experiment() | DEBUG | Experiment name is present 2024-06-13 11:27:01,342 | kfadapter_main.py 88 get_experiment() | DEBUG | {'created_at': None, 'description': None, 'id': 'exp-id', 'name': 'exp-name', 'resource_references': None, 'storage_state': None} 2024-06-13 11:27:01,349 | kfadapter_main.py 230 get_pipeline() | DEBUG | {'created_at': None, 'default_version': {'code_source_url': None, 'created_at': None, 'description': None, 'id': None, 'name': None, 'package_url': None, 'parameters': [{'name': 'param-name2', 'value': 'param-value2'}, {'name': 'param-name3', 'value': 'param-value3'}], 'resource_references': None}, 'description': 'description', 'error': None, 'id': 'pipeline-name', 'name': 'pipeline-id', 'parameters': [{'name': 'param-name0', 'value': 'param-value0'}, {'name': 'param-name1', 'value': 'param-value1'}], 'resource_references': None, 'url': None} 2024-06-13 11:27:01,355 | kfadapter_main.py 125 get_pipeline_id() | DEBUG | pipeline-id 2024-06-13 11:27:01,363 | kfadapter_main.py 508 kf_run() | DEBUG | {'run_id': 'run-id', 'run_name': 'run-name', 'run_status': 'Running'} 2024-06-13 11:27:01,372 | kfadapter_main.py 130 get_pipeline_id() | DEBUG | Uploading received for pipeline.zip 2024-06-13 11:27:01,372 | kfadapter_main.py 134 get_pipeline_id() | DEBUG | File uploaded :/tmp/pipeline.zip 2024-06-13 11:27:01,373 | kfadapter_main.py 140 get_pipeline_id() | DEBUG | Pipeline uploaded :pipeline-name 2024-06-13 11:27:01,374 | kfadapter_kfconnect.py 43 __init__() | DEBUG | Initialized KfConnect 2024-06-13 11:27:01,377 | kfadapter_main.py 352 run_pipeline() | DEBUG | run_pipeline for job_name 2024-06-13 11:27:01,377 | kfadapter_main.py 358 run_pipeline() | DEBUG | {'arguments': {'nosuchname': 'nosuchvalue'}, 'pipeline_name': 'pipeline-name', 'pipeline_version': '2.0.0', 'experiment_name': 'exp-name'} 2024-06-13 11:27:01,377 | kfadapter_main.py 373 run_pipeline() | DEBUG | {'created_at': None, 'description': None, 'id': 'exp-id', 'name': None, 'resource_references': None, 'storage_state': None} 2024-06-13 11:27:01,378 | kfadapter_main.py 378 run_pipeline() | DEBUG | Pipeline ID = pipeline-id 2024-06-13 11:27:01,378 | kfadapter_main.py 381 run_pipeline() | DEBUG | Getting pipeline desc 2024-06-13 11:27:01,378 | kfadapter_main.py 384 run_pipeline() | DEBUG | {'created_at': None, 'default_version': {'code_source_url': None, 'created_at': None, 'description': None, 'id': None, 'name': None, 'package_url': None, 'parameters': [{'name': 'param-name2', 'value': 'param-value2'}, {'name': 'param-name3', 'value': 'param-value3'}], 'resource_references': None}, 'description': 'pipeline-description', 'error': None, 'id': 'pipeline-name', 'name': 'pipeline-id', 'parameters': [{'name': 'param-name0', 'value': 'param-value0'}, {'name': 'param-name1', 'value': 'param-value1'}], 'resource_references': None, 'url': None} 2024-06-13 11:27:01,382 | kfadapter_main.py 387 run_pipeline() | DEBUG | Arguments provided dict_keys(['nosuchname']) 2024-06-13 11:27:01,382 | kfadapter_main.py 388 run_pipeline() | DEBUG | Arguments in pipeline dict_keys(['param-name2', 'param-name3']) 2024-06-13 11:27:01,382 | kfadapter_main.py 391 run_pipeline() | ERROR | arguments: {'nosuchname': 'nosuchvalue'} 2024-06-13 11:27:01,382 | kfadapter_main.py 392 run_pipeline() | ERROR | pipe_arg: {'param-name2': 'param-value2', 'param-name3': 'param-value3'} 2024-06-13 11:27:01,382 | kfadapter_main.py 418 run_pipeline() | ERROR | Arguments does not match with pipeline arguments 2024-06-13 11:27:01,385 | kfadapter_main.py 352 run_pipeline() | DEBUG | run_pipeline for job_name 2024-06-13 11:27:01,385 | kfadapter_main.py 358 run_pipeline() | DEBUG | {} 2024-06-13 11:27:01,388 | kfadapter_main.py 352 run_pipeline() | DEBUG | run_pipeline for job_name 2024-06-13 11:27:01,389 | kfadapter_main.py 358 run_pipeline() | DEBUG | {'arguments': {'param-name0': 'param-value0', 'param-name1': 'param-value1'}, 'pipeline_name': 'pipeline-name', 'pipeline_version': '2.0.0', 'experiment_name': 'exp-name'} 2024-06-13 11:27:01,389 | kfadapter_main.py 418 run_pipeline() | ERROR | Experiment name is not correct exp-name 2024-06-13 11:27:01,392 | kfadapter_main.py 352 run_pipeline() | DEBUG | run_pipeline for job_name 2024-06-13 11:27:01,392 | kfadapter_main.py 358 run_pipeline() | DEBUG | {'arguments': {'param-name0': 'param-value0', 'param-name1': 'param-value1'}, 'pipeline_name': 'pipeline-name', 'pipeline_version': '2.0.0', 'experiment_name': 'exp-name'} 2024-06-13 11:27:01,392 | kfadapter_main.py 373 run_pipeline() | DEBUG | {'created_at': None, 'description': None, 'id': 'exp-id', 'name': None, 'resource_references': None, 'storage_state': None} 2024-06-13 11:27:01,393 | kfadapter_main.py 418 run_pipeline() | ERROR | Pipeline name is not correct pipeline-name 2024-06-13 11:27:01,396 | kfadapter_main.py 471 list_runs() | ERROR | Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 454, in list_runs runs = KFCONNECT_KF_OBJ.get_kf_list_runs(KFCONNECT_CONFIG_OBJ.kf_dict['kfdefaultns']) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1178, in __call__ return _mock_self._mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1182, in _mock_call return _mock_self._execute_mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1239, in _execute_mock_call raise effect IndexError 2024-06-13 11:27:01,399 | kfadapter_main.py 92 get_experiment() | ERROR | Experiment name is not correct exp-name 2024-06-13 11:27:01,402 | kfadapter_main.py 86 get_experiment() | DEBUG | Experiment name is present 2024-06-13 11:27:01,402 | kfadapter_main.py 88 get_experiment() | DEBUG | 2024-06-13 11:27:01,403 | kfadapter_main.py 97 get_experiment() | ERROR | Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 89, in get_experiment exp_dict['name'] = exp.name AttributeError: 'IndexError' object has no attribute 'name' 2024-06-13 11:27:01,408 | kfadapter_main.py 283 list_experiments() | ERROR | Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 279, in list_experiments for experiment in exp.experiments: AttributeError: 'IndexError' object has no attribute 'experiments' 2024-06-13 11:27:01,410 | kfadapter_main.py 238 get_pipeline() | ERROR | Exception from KubeFlow 2024-06-13 11:27:01,411 | kfadapter_main.py 239 get_pipeline() | ERROR | (None) Reason: None 2024-06-13 11:27:01,413 | kfadapter_main.py 147 get_pipeline_id() | ERROR | No pipeline is found with name pipeline-name 2024-06-13 11:27:01,416 | kfadapter_main.py 323 list_pipelines() | ERROR | Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 308, in list_pipelines pipeline_list = KFCONNECT_KF_OBJ.get_kf_list_pipelines() File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1178, in __call__ return _mock_self._mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1182, in _mock_call return _mock_self._execute_mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1239, in _execute_mock_call raise effect IndexError 2024-06-13 11:27:01,419 | kfadapter_main.py 510 kf_run() | ERROR | Exception from KubeFlow in run 2024-06-13 11:27:01,419 | kfadapter_main.py 511 kf_run() | ERROR | 2024-06-13 11:27:01,422 | kfadapter_main.py 187 get_versions_for_pipeline() | ERROR | Exception from KubeFlow 2024-06-13 11:27:01,422 | kfadapter_main.py 188 get_versions_for_pipeline() | ERROR | (None) Reason: None 2024-06-13 11:27:01,422 | app.py 1744 log_exception() | ERROR | Exception on /pipelines/pipeline-name/versions [GET] Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 184, in get_versions_for_pipeline versions_list = KFCONNECT_KF_OBJ.get_pl_versions_by_pl_name( File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1178, in __call__ return _mock_self._mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1182, in _mock_call return _mock_self._execute_mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1239, in _execute_mock_call raise effect kfp_server_api.exceptions.ApiException: (None) Reason: None During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/flask/app.py", line 2529, in wsgi_app response = self.full_dispatch_request() File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/flask/app.py", line 1825, in full_dispatch_request rv = self.handle_user_exception(e) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/flask/app.py", line 1823, in full_dispatch_request rv = self.dispatch_request() File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/flask/app.py", line 1799, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 189, in get_versions_for_pipeline raise BadRequest(check_map(json.loads(err.body), "error_details"),\ File "/opt/pyenv/versions/3.10.6/lib/python3.10/json/__init__.py", line 339, in loads raise TypeError(f'the JSON object must be str, bytes or bytearray, ' TypeError: the JSON object must be str, bytes or bytearray, not NoneType 2024-06-13 11:27:01,427 | kfadapter_main.py 193 get_versions_for_pipeline() | ERROR | Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 184, in get_versions_for_pipeline versions_list = KFCONNECT_KF_OBJ.get_pl_versions_by_pl_name( File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1178, in __call__ return _mock_self._mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1182, in _mock_call return _mock_self._execute_mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1239, in _execute_mock_call raise effect IndexError 2024-06-13 11:27:01,432 | kfadapter_main.py 130 get_pipeline_id() | DEBUG | Uploading received for 2024-06-13 11:27:01,433 | kfadapter_main.py 158 get_pipeline_id() | ERROR | Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 145, in get_pipeline_id raise Exception("Error saving file from POST") Exception: Error saving file from POST 2024-06-13 11:27:01,438 | kfadapter_main.py 130 get_pipeline_id() | DEBUG | Uploading received for pipeline.zip 2024-06-13 11:27:01,438 | kfadapter_main.py 134 get_pipeline_id() | DEBUG | File uploaded :/tmp/pipeline.zip 2024-06-13 11:27:01,438 | kfadapter_main.py 151 get_pipeline_id() | ERROR | Exception from KubeFlow 2024-06-13 11:27:01,438 | kfadapter_main.py 152 get_pipeline_id() | ERROR | (None) Reason: None 2024-06-13 11:27:01,438 | app.py 1744 log_exception() | ERROR | Exception on /pipelineIds/pipeline-name [POST] Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 136, in get_pipeline_id pipe_info = KFCONNECT_KF_OBJ.upload_pipeline_with_versions( File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1178, in __call__ return _mock_self._mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1182, in _mock_call return _mock_self._execute_mock_call(*args, **kwargs) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/mock/mock.py", line 1239, in _execute_mock_call raise effect kfp_server_api.exceptions.ApiException: (None) Reason: None During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/flask/app.py", line 2529, in wsgi_app response = self.full_dispatch_request() File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/flask/app.py", line 1825, in full_dispatch_request rv = self.handle_user_exception(e) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/flask/app.py", line 1823, in full_dispatch_request rv = self.dispatch_request() File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/.tox/code/lib/python3.10/site-packages/flask/app.py", line 1799, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) File "/w/workspace/aiml-fw-athp-tps-kubeflow-adapter-tox-sonarqube/kfadapter/kfadapter_main.py", line 154, in get_pipeline_id raise BadRequest(check_map(json.loads(err.body), "error_details"),\ File "/opt/pyenv/versions/3.10.6/lib/python3.10/json/__init__.py", line 339, in loads raise TypeError(f'the JSON object must be str, bytes or bytearray, ' TypeError: the JSON object must be str, bytes or bytearray, not NoneType