Running pipeline stage VLLMUploader
Shutdown handler not registered because Python interpreter is not running in the main thread
Starting job with name chaiml-kimid-v9-opusdv1-83165-v8-uploader
run pipeline %s
run pipeline stage %s
Waiting for job on chaiml-kimid-v9-opusdv1-83165-v8-uploader to finish
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v8b-kimidv-63800-v8-uploader
Waiting for job on chaiml-kimid-v8b-kimidv-63800-v8-uploader to finish
chaiml-kimid-v9-opusdv1-83165-v8-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-kimid-v9-opusdv1-83165-v8-uploader: __import__('pkg_resources').declare_namespace(__name__)
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ██████ ██████ █████ ████ ████ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: __import__('pkg_resources').declare_namespace(__name__)
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ██████ ██████ █████ ████ ████ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ █████ █████ █████ ░░████ █████ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ Version: 0.30.6+torch280 ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ Features: FLYWHEEL, CUDA ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ █████ █████ █████ ░░████ █████ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ https://mk1.ai ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ Version: 0.30.6+torch280 ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ The license key for the current software has been verified as ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ Features: FLYWHEEL, CUDA ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ belonging to: ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ https://mk1.ai ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ Chai Research Corp. ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ The license key for the current software has been verified as ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ belonging to: ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ║ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ║
chaiml-kimid-v9-opusdv1-83165-v8-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ Chai Research Corp. ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ║ ║
chaiml-kimid-v8b-kimidv-63800-v8-uploader: ╚═════════════════════════════════════════════════════════════════════╝
Tearing down inference service chaiml-kimid-v9-opusdv1-83165-v7
clean up pipeline due to error=DeploymentError('404\nReason: Not Found\nHTTP response headers: HTTPHeaderDict({\'Audit-Id\': \'1e9453e5-2d1e-4253-b33b-1c0edd0cd9fb, d8c9f2f8-7f34-4c22-8b69-c100646dae67\', \'Cache-Control\': \'no-cache, private, no-cache, private\', \'Content-Length\': \'304\', \'Content-Type\': \'application/json\', \'Date\': \'Tue, 13 Jan 2026 22:35:20 GMT\', \'X-Kubernetes-Pf-Flowschema-Uid\': \'6d61b0c7-bf04-4f40-8d77-09fab6d530e3\', \'X-Kubernetes-Pf-Prioritylevel-Uid\': \'575fa237-17f0-45cc-909e-dda8024470d8\'})\nHTTP response body: b\'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"inferenceservices.serving.kserve.io \\\\"chaiml-kimid-v9-opusdv1-83165-v7\\\\" not found","reason":"NotFound","details":{"name":"chaiml-kimid-v9-opusdv1-83165-v7","group":"serving.kserve.io","kind":"inferenceservices"},"code":404}\\n\'\nOriginal traceback: \n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/dynamic/client.py", line 55, in inner\n resp = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/dynamic/client.py", line 273, in request\n api_response = self.client.call_api(\n ^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 348, in call_api\n return self.__call_api(resource_path, method,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 180, in __call_api\n response_data = self.request(\n ^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 415, in request\n return self.rest_client.DELETE(url,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/rest.py", line 270, in DELETE\n return self.request("DELETE", url,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/rest.py", line 238, in request\n raise ApiException(http_resp=r)\n')
run pipeline stage %s
Running pipeline stage VLLMDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage VLLMDeleter completed in 0.91s
Shutdown handler de-registered
DeploymentError('404\nReason: Not Found\nHTTP response headers: HTTPHeaderDict({\'Audit-Id\': \'1e9453e5-2d1e-4253-b33b-1c0edd0cd9fb, d8c9f2f8-7f34-4c22-8b69-c100646dae67\', \'Cache-Control\': \'no-cache, private, no-cache, private\', \'Content-Length\': \'304\', \'Content-Type\': \'application/json\', \'Date\': \'Tue, 13 Jan 2026 22:35:20 GMT\', \'X-Kubernetes-Pf-Flowschema-Uid\': \'6d61b0c7-bf04-4f40-8d77-09fab6d530e3\', \'X-Kubernetes-Pf-Prioritylevel-Uid\': \'575fa237-17f0-45cc-909e-dda8024470d8\'})\nHTTP response body: b\'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"inferenceservices.serving.kserve.io \\\\"chaiml-kimid-v9-opusdv1-83165-v7\\\\" not found","reason":"NotFound","details":{"name":"chaiml-kimid-v9-opusdv1-83165-v7","group":"serving.kserve.io","kind":"inferenceservices"},"code":404}\\n\'\nOriginal traceback: \n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/dynamic/client.py", line 55, in inner\n resp = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/dynamic/client.py", line 273, in request\n api_response = self.client.call_api(\n ^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 348, in call_api\n return self.__call_api(resource_path, method,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 180, in __call_api\n response_data = self.request(\n ^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 415, in request\n return self.rest_client.DELETE(url,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/rest.py", line 270, in DELETE\n return self.request("DELETE", url,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/rest.py", line 238, in request\n raise ApiException(http_resp=r)\n')
chaiml-kimid-v9-opusdv1_83165_v7 status is now failed due to DeploymentManager action
Tearing down inference service chaiml-kimid-v8b-kimidv-63800-v7
clean up pipeline due to error=DeploymentError('404\nReason: Not Found\nHTTP response headers: HTTPHeaderDict({\'Audit-Id\': \'1ee6fc2b-d081-4ecd-b89e-1c617a4ccfd5, a37caa12-24b3-43e6-b056-eb6d6c10c36d\', \'Cache-Control\': \'no-cache, private, no-cache, private\', \'Content-Length\': \'304\', \'Content-Type\': \'application/json\', \'Date\': \'Tue, 13 Jan 2026 22:35:50 GMT\', \'X-Kubernetes-Pf-Flowschema-Uid\': \'6d61b0c7-bf04-4f40-8d77-09fab6d530e3\', \'X-Kubernetes-Pf-Prioritylevel-Uid\': \'575fa237-17f0-45cc-909e-dda8024470d8\'})\nHTTP response body: b\'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"inferenceservices.serving.kserve.io \\\\"chaiml-kimid-v8b-kimidv-63800-v7\\\\" not found","reason":"NotFound","details":{"name":"chaiml-kimid-v8b-kimidv-63800-v7","group":"serving.kserve.io","kind":"inferenceservices"},"code":404}\\n\'\nOriginal traceback: \n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/dynamic/client.py", line 55, in inner\n resp = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/dynamic/client.py", line 273, in request\n api_response = self.client.call_api(\n ^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 348, in call_api\n return self.__call_api(resource_path, method,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 180, in __call_api\n response_data = self.request(\n ^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 415, in request\n return self.rest_client.DELETE(url,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/rest.py", line 270, in DELETE\n return self.request("DELETE", url,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/rest.py", line 238, in request\n raise ApiException(http_resp=r)\n')
run pipeline stage %s
Running pipeline stage VLLMDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage VLLMDeleter completed in 0.64s
Shutdown handler de-registered
DeploymentError('404\nReason: Not Found\nHTTP response headers: HTTPHeaderDict({\'Audit-Id\': \'1ee6fc2b-d081-4ecd-b89e-1c617a4ccfd5, a37caa12-24b3-43e6-b056-eb6d6c10c36d\', \'Cache-Control\': \'no-cache, private, no-cache, private\', \'Content-Length\': \'304\', \'Content-Type\': \'application/json\', \'Date\': \'Tue, 13 Jan 2026 22:35:50 GMT\', \'X-Kubernetes-Pf-Flowschema-Uid\': \'6d61b0c7-bf04-4f40-8d77-09fab6d530e3\', \'X-Kubernetes-Pf-Prioritylevel-Uid\': \'575fa237-17f0-45cc-909e-dda8024470d8\'})\nHTTP response body: b\'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"inferenceservices.serving.kserve.io \\\\"chaiml-kimid-v8b-kimidv-63800-v7\\\\" not found","reason":"NotFound","details":{"name":"chaiml-kimid-v8b-kimidv-63800-v7","group":"serving.kserve.io","kind":"inferenceservices"},"code":404}\\n\'\nOriginal traceback: \n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/dynamic/client.py", line 55, in inner\n resp = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/dynamic/client.py", line 273, in request\n api_response = self.client.call_api(\n ^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 348, in call_api\n return self.__call_api(resource_path, method,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 180, in __call_api\n response_data = self.request(\n ^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/api_client.py", line 415, in request\n return self.rest_client.DELETE(url,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/rest.py", line 270, in DELETE\n return self.request("DELETE", url,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File "/root/miniconda3/envs/guanaco/lib/python3.11/site-packages/kubernetes/client/rest.py", line 238, in request\n raise ApiException(http_resp=r)\n')
chaiml-kimid-v8b-kimidv_63800_v7 status is now failed due to DeploymentManager action
chaiml-kimid-v9-opusdv1-83165-v8-uploader: Downloaded to shared memory in 126.882s
chaiml-kimid-v8b-kimidv-63800-v8-uploader: Downloaded to shared memory in 124.886s
chaiml-kimid-v9-opusdv1-83165-v8-uploader: Processed model ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-int4-mixed in 190.624s
chaiml-kimid-v9-opusdv1-83165-v8-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v9-opusdv1-83165-v8-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v9-opusdv1-83165-v8-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/added_tokens.json
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/README.md s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/README.md
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/chat_template.jinja
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/.gitattributes
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/generation_config.json
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/config.json
chaiml-kimid-v8b-kimidv-63800-v8-uploader: Processed model ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed in 190.908s
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/quantization_config.json
chaiml-kimid-v8b-kimidv-63800-v8-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/tokenizer_config.json
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/special_tokens_map.json
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/vocab.json
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model.safetensors.index.json
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/merges.txt
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00027-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00027-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00023-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00001-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00018-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00008-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00015-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00005-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00022-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00017-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00021-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00010-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00018-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00013-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00014-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00019-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00016-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00004-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00021-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00010-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00013-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00015-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00003-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00026-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00016-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00004-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00007-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00025-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00022-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00003-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00002-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00001-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00019-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00009-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00023-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00017-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00024-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00008-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00011-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00014-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00020-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00011-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v8-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v8/model-00012-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00024-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00020-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00006-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v8-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v8/model-00026-of-00027.safetensors
Job chaiml-kimid-v8b-kimidv-63800-v8-uploader completed after 573.52s with status: succeeded
Stopping job with name chaiml-kimid-v8b-kimidv-63800-v8-uploader
Pipeline stage VLLMUploader completed in 575.77s
Job chaiml-kimid-v9-opusdv1-83165-v8-uploader completed after 575.79s with status: succeeded
run pipeline stage %s
Stopping job with name chaiml-kimid-v9-opusdv1-83165-v8-uploader
Running pipeline stage VLLMTemplater
Pipeline stage VLLMUploader completed in 578.02s
Pipeline stage VLLMTemplater completed in 0.35s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Running pipeline stage VLLMDeployer
Pipeline stage VLLMTemplater completed in 0.36s
Creating inference service chaiml-kimid-v8b-kimidv-63800-v8
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v9-opusdv1-83165-v8
Waiting for inference service chaiml-kimid-v8b-kimidv-63800-v8 to be ready
Waiting for inference service chaiml-kimid-v9-opusdv1-83165-v8 to be ready
Inference service chaiml-kimid-v9-opusdv1-83165-v8 ready after 455.573215007782s
Pipeline stage VLLMDeployer completed in 457.54s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9905247688293457s
Received healthy response to inference request in 2.4008564949035645s
Received healthy response to inference request in 1.8951570987701416s
Inference service chaiml-kimid-v8b-kimidv-63800-v8 ready after 465.4269633293152s
Pipeline stage VLLMDeployer completed in 467.04s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7129268646240234s
Received healthy response to inference request in 1.921762466430664s
Received healthy response to inference request in 2.327944278717041s
Received healthy response to inference request in 1.8476393222808838s
Received healthy response to inference request in 1.7620620727539062s
Received healthy response to inference request in 1.8831562995910645s
Received healthy response to inference request in 2.4206931591033936s
Received healthy response to inference request in 1.851522445678711s
Received healthy response to inference request in 2.385946035385132s
Received healthy response to inference request in 2.386347532272339s
Received healthy response to inference request in 2.373197555541992s
Received healthy response to inference request in 2.514521598815918s
Received healthy response to inference request in 2.1210029125213623s
Received healthy response to inference request in 2.29129958152771s
Received healthy response to inference request in 2.0131826400756836s
Received healthy response to inference request in 1.853670358657837s
Received healthy response to inference request in 1.8925578594207764s
Received healthy response to inference request in 2.145615339279175s
Received healthy response to inference request in 1.9712071418762207s
Received healthy response to inference request in 2.062619686126709s
Received healthy response to inference request in 2.014268159866333s
Received healthy response to inference request in 2.292847156524658s
Received healthy response to inference request in 2.379290819168091s
Received healthy response to inference request in 1.9342334270477295s
Received healthy response to inference request in 1.7790024280548096s
Received healthy response to inference request in 2.3453238010406494s
Received healthy response to inference request in 1.8091208934783936s
Received healthy response to inference request in 2.2641849517822266s
Received healthy response to inference request in 1.8427355289459229s
Received healthy response to inference request in 1.9892117977142334s
Received healthy response to inference request in 1.817901372909546s
Received healthy response to inference request in 2.408052682876587s
Received healthy response to inference request in 1.7363722324371338s
Received healthy response to inference request in 2.0302860736846924s
Received healthy response to inference request in 1.883634090423584s
Received healthy response to inference request in 1.897249698638916s
Received healthy response to inference request in 2.342589855194092s
Received healthy response to inference request in 1.8474087715148926s
Received healthy response to inference request in 1.7864243984222412s
Received healthy response to inference request in 2.4555625915527344s
Received healthy response to inference request in 1.7535345554351807s
Received healthy response to inference request in 1.8702542781829834s
Received healthy response to inference request in 2.1023263931274414s
Received healthy response to inference request in 2.0073180198669434s
Received healthy response to inference request in 1.9694297313690186s
Received healthy response to inference request in 2.1672000885009766s
Received healthy response to inference request in 2.2526564598083496s
Received healthy response to inference request in 2.1598634719848633s
Received healthy response to inference request in 1.888883352279663s
Received healthy response to inference request in 1.9587414264678955s
Received healthy response to inference request in 1.9133024215698242s
Received healthy response to inference request in 1.8367204666137695s
Received healthy response to inference request in 1.7507476806640625s
30 requests
0 failed requests
5th percentile: 1.7520017743110656
10th percentile: 1.7612093210220336
Received healthy response to inference request in 1.876000165939331s
20th percentile: 1.811605978012085
30th percentile: 1.8873085737228394
40th percentile: 1.9258610248565675
50th percentile: 1.9898682832717896
60th percentile: 2.1196419715881345
70th percentile: 2.2723193407058715
80th percentile: 2.330873394012451
90th percentile: 2.4028401613235473
95th percentile: 2.4722988009452815
99th percentile: 2.655389337539673
Received healthy response to inference request in 1.8458049297332764s
mean time: 2.0740373214085897
Pipeline stage StressChecker completed in 72.53s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 1.9882261753082275s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.57s
Shutdown handler de-registered
chaiml-kimid-v9-opusdv1_83165_v8 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 1.8781476020812988s
30 requests
0 failed requests
5th percentile: 1.8394272446632385
10th percentile: 1.845497989654541
20th percentile: 1.8507458209991454
30th percentile: 1.8775033712387086
40th percentile: 1.8953729629516602
50th percentile: 1.964974284172058
60th percentile: 2.0096638679504393
70th percentile: 2.057501125335693
80th percentile: 2.2028248310089116
90th percentile: 2.379996490478516
95th percentile: 2.3982853651046754
99th percentile: 2.4417847180366516
mean time: 2.0293050607045493
Pipeline stage StressChecker completed in 69.61s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.00s
Shutdown handler de-registered
chaiml-kimid-v8b-kimidv_63800_v8 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 3238.16s
Shutdown handler de-registered
chaiml-kimid-v8b-kimidv_63800_v8 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of chaiml-kimid-v8b-kimidv_63800_v8
Shutdown handler not registered because Python interpreter is not running in the main thread
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
run pipeline %s
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
run pipeline stage %s
Falling back to EndpointApi.from_submission implementation
Running pipeline stage VLLMDeleter
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Checking if service chaiml-kimid-v8b-kimidv-63800-v8 is running
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Tearing down inference service chaiml-kimid-v8b-kimidv-63800-v8
Falling back to EndpointApi.from_submission implementation
Service chaiml-kimid-v8b-kimidv-63800-v8 has been torndown
Falling back to EndpointApi.from_submission implementation
Pipeline stage VLLMDeleter completed in 0.98s
run pipeline stage %s
Running pipeline stage VLLMModelDeleter
Cleaning model data from S3
Falling back to EndpointApi.from_submission implementation
Cleaning model data from model cache
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/.gitattributes from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/README.md from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/added_tokens.json from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/chat_template.jinja from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/config.json from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/generation_config.json from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/merges.txt from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00001-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00002-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00003-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00004-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00005-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00006-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00007-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00008-of-00027.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00009-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00010-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00011-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00012-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00013-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00014-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00015-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00016-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00017-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00018-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00019-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00020-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00021-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00022-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00023-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00024-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00025-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00026-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model-00027-of-00027.safetensors from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/model.safetensors.index.json from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/quantization_config.json from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/special_tokens_map.json from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/tokenizer.json from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/tokenizer_config.json from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Deleting key chaiml-kimid-v8b-kimidv-63800-v8/vocab.json from bucket guanaco-vllm-models
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Pipeline stage VLLMModelDeleter completed in 17.29s
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Shutdown handler de-registered
Falling back to EndpointApi.from_submission implementation
chaiml-kimid-v8b-kimidv_63800_v8 status is now torndown due to DeploymentManager action
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation