submission_id: chaiml-kimid-v9-opusdv_23365_v27
developer_uid: richhx
status: inactive
model_repo: ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|assistant|>', '####', '</think>', '<|user|>', '<|im_end|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
timestamp: 2026-03-23T16:04:55+00:00
model_name: chaiml-kimid-v9-opusdv_23365_v27
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v9-opusdv-23365-v27-uploader
Waiting for job on chaiml-kimid-v9-opusdv-23365-v27-uploader to finish
chaiml-kimid-v9-opusdv-23365-v27-uploader: Using quantization_mode: w4a16
2026-03-23T15:56:47.494459+00:00 monitor updated for chaiml-kimid-v9-opusdv_23365_v27
2026-03-23T15:57:47.618410+00:00 monitor updated for chaiml-kimid-v9-opusdv_23365_v27
2026-03-23T15:58:48.224963+00:00 monitor updated for chaiml-kimid-v9-opusdv_23365_v27
chaiml-kimid-v9-opusdv-23365-v27-uploader: Downloaded in 135.616s
chaiml-kimid-v9-opusdv-23365-v27-uploader: Processed model ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01 in 136.250s
chaiml-kimid-v9-opusdv-23365-v27-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v9-opusdv-23365-v27-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v9-opusdv-23365-v27-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-kimid-v9-opusdv-23365-v27-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-kimid-v9-opusdv-23365-v27-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-kimid-v9-opusdv-23365-v27-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v9-opusdv-23365-v27-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-kimid-v9-opusdv-23365-v27-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v9-opusdv-23365-v27-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-kimid-v9-opusdv-23365-v27-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v9-opusdv-23365-v27-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-kimid-v9-opusdv-23365-v27-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v9-opusdv-23365-v27-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-kimid-v9-opusdv-23365-v27-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-kimid-v9-opusdv-23365-v27-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-kimid-v9-opusdv-23365-v27-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-kimid-v9-opusdv-23365-v27-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-kimid-v9-opusdv-23365-v27-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v9-opusdv-23365-v27-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/config.json
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/generation_config.json
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/.gitattributes
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/chat_template.jinja
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/merges.txt
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/special_tokens_map.json
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/added_tokens.json
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/quantization_config.json
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/tokenizer_config.json
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/vocab.json
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/tokenizer.json
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model.safetensors.index.json
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00027-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00011-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00014-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00025-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00013-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00005-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00009-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00001-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00024-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00020-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00018-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00023-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00002-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00012-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00010-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00003-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00026-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00004-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00017-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00016-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00007-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00021-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00008-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00019-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00015-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00006-of-00027.safetensors
chaiml-kimid-v9-opusdv-23365-v27-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-23365-v27/default/model-00022-of-00027.safetensors
Job chaiml-kimid-v9-opusdv-23365-v27-uploader completed after 216.52s with status: succeeded
Stopping job with name chaiml-kimid-v9-opusdv-23365-v27-uploader
Pipeline stage VLLMUploader completed in 217.12s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 3.43s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v9-opusdv-23365-v27
Waiting for inference service chaiml-kimid-v9-opusdv-23365-v27 to be ready
2026-03-23T15:59:48.311485+00:00 monitor updated for chaiml-kimid-v9-opusdv_23365_v27
2026-03-23T16:00:48.404350+00:00 monitor updated for chaiml-kimid-v9-opusdv_23365_v27
2026-03-23T16:01:48.495131+00:00 monitor updated for chaiml-kimid-v9-opusdv_23365_v27
2026-03-23T16:02:48.701562+00:00 monitor updated for chaiml-kimid-v9-opusdv_23365_v27
Inference service chaiml-kimid-v9-opusdv-23365-v27 ready after 241.19771194458008s
Pipeline stage VLLMDeployer completed in 241.68s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.224422216415405s
Received healthy response to inference request in 2.124079465866089s
Received healthy response to inference request in 3.8914923667907715s
Received healthy response to inference request in 1.9578583240509033s
Received healthy response to inference request in 1.877323865890503s
Received healthy response to inference request in 1.9126763343811035s
2026-03-23T16:03:48.795134+00:00 monitor updated for chaiml-kimid-v9-opusdv_23365_v27
Received healthy response to inference request in 3.891547203063965s
Received healthy response to inference request in 2.122734785079956s
Received healthy response to inference request in 1.8731634616851807s
Received healthy response to inference request in 1.965329885482788s
Received healthy response to inference request in 1.8573997020721436s
Received healthy response to inference request in 1.9926655292510986s
Received healthy response to inference request in 1.8974480628967285s
Received healthy response to inference request in 2.37851619720459s
Received healthy response to inference request in 1.9592409133911133s
Received healthy response to inference request in 2.124741554260254s
Received healthy response to inference request in 1.876476764678955s
Received healthy response to inference request in 4.0531628131866455s
Received healthy response to inference request in 1.9538977146148682s
Received healthy response to inference request in 2.1991121768951416s
Received healthy response to inference request in 1.9619851112365723s
Received healthy response to inference request in 1.9688165187835693s
Received healthy response to inference request in 1.8622024059295654s
Received healthy response to inference request in 1.9274790287017822s
Received healthy response to inference request in 1.873598337173462s
Received healthy response to inference request in 1.9480273723602295s
Received healthy response to inference request in 4.002151250839233s
Received healthy response to inference request in 2.1845908164978027s
Received healthy response to inference request in 2.004580020904541s
Received healthy response to inference request in 2.078875780105591s
30 requests
0 failed requests
5th percentile: 1.8671348810195922
10th percentile: 1.8735548496246337
20th percentile: 1.8934232234954833
30th percentile: 1.9418628692626954
40th percentile: 1.9586878776550294
50th percentile: 1.9670732021331787
60th percentile: 2.034298324584961
70th percentile: 2.1242780923843383
80th percentile: 2.2349929809570317
90th percentile: 3.902607607841492
95th percentile: 4.03020761013031
99th percentile: 4.174756989479065
mean time: 2.331519865989685
Pipeline stage StressChecker completed in 74.28s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.49s
Shutdown handler de-registered
chaiml-kimid-v9-opusdv_23365_v27 status is now deployed due to DeploymentManager action
chaiml-kimid-v9-opusdv_23365_v27 status is now inactive due to admin request