chaiml-evening-swim-v1-_35535

developer_uid: rirv938
submission_id: chaiml-evening-swim-v1-_35535_v2
model_name: chaiml-evening-swim-v1-_35535_v2
model_group: ChaiML/evening_swim_v1_g
status: inactive
timestamp: 2026-03-18T05:18:21+00:00
num_battles: 13079
num_wins: 5909
celo_rating: 1260.43
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/evening_swim_v1_glm_air-step1125-merged
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 9073971200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-evening-swim-v1-_35535_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/evening_swim_v1_glm_air-step1125-merged
model_size: 9B
ranking_group: single
us_pacific_date: 2026-03-17
win_ratio: 0.4517929505313862
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', 'You:', '</s>', '###', '<|im_start|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[gMASK]<sop><|system|>\nRespond as a high quality storyteller.<|user|>\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-evening-swim-v1-35535-v2-uploader
Waiting for job on chaiml-evening-swim-v1-35535-v2-uploader to finish
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-evening-swim-v1-55586-v2-uploader
Waiting for job on chaiml-evening-swim-v1-55586-v2-uploader to finish
chaiml-evening-swim-v1-35535-v2-uploader: Using quantization_mode: none
chaiml-evening-swim-v1-35535-v2-uploader: Downloading snapshot of ChaiML/evening_swim_v1_glm_air-step1125-merged...
chaiml-evening-swim-v1-55586-v2-uploader: Using quantization_mode: none
chaiml-evening-swim-v1-55586-v2-uploader: Downloading snapshot of ChaiML/evening_swim_v1_glm_air-step2250-merged...
chaiml-evening-swim-v1-35535-v2-uploader: Downloaded in 73.533s
chaiml-evening-swim-v1-55586-v2-uploader: Downloaded in 70.941s
chaiml-evening-swim-v1-55586-v2-uploader: Processed model ChaiML/evening_swim_v1_glm_air-step2250-merged in 148.814s
chaiml-evening-swim-v1-55586-v2-uploader: creating bucket guanaco-vllm-models
chaiml-evening-swim-v1-55586-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-evening-swim-v1-55586-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-evening-swim-v1-55586-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-evening-swim-v1-55586-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-evening-swim-v1-55586-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-evening-swim-v1-35535-v2-uploader: Processed model ChaiML/evening_swim_v1_glm_air-step1125-merged in 153.044s
chaiml-evening-swim-v1-55586-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-35535-v2-uploader: creating bucket guanaco-vllm-models
chaiml-evening-swim-v1-55586-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-evening-swim-v1-35535-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-35535-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-evening-swim-v1-55586-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-evening-swim-v1-35535-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-evening-swim-v1-55586-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-evening-swim-v1-35535-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-evening-swim-v1-55586-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-evening-swim-v1-35535-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-evening-swim-v1-35535-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-evening-swim-v1-55586-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-evening-swim-v1-35535-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-evening-swim-v1-35535-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-evening-swim-v1-55586-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default
chaiml-evening-swim-v1-35535-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/config.json
chaiml-evening-swim-v1-35535-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-evening-swim-v1-35535-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-35535-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-evening-swim-v1-35535-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-evening-swim-v1-35535-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-evening-swim-v1-35535-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-evening-swim-v1-35535-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-evening-swim-v1-35535-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-evening-swim-v1-35535-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/tokenizer_config.json
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/config.json
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/.gitattributes
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/README.md
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/generation_config.json
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/chat_template.jinja
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/special_tokens_map.json
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model.safetensors.index.json
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/tokenizer.json
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00043-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00043-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00023-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00004-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00022-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00022-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00036-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00042-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00029-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00007-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00018-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00001-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00014-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00023-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00035-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00035-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00027-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00002-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00032-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00041-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00037-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00017-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00020-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00025-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00026-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00034-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00028-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00006-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00021-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00040-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00040-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00042-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00019-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00011-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00031-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00013-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00011-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00018-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00033-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00033-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00026-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00012-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00031-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00015-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00002-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00014-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00027-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00001-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00036-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00021-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00034-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00039-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00039-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00005-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00020-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00017-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00025-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00028-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00037-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00030-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00024-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00008-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00041-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00016-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00003-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00029-of-00043.safetensors
chaiml-evening-swim-v1-55586-v2-uploader: cp /dev/shm/model_output/model-00038-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v2/default/model-00038-of-00043.safetensors
chaiml-evening-swim-v1-35535-v2-uploader: cp /dev/shm/model_output/model-00038-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v2/default/model-00038-of-00043.safetensors
Job chaiml-evening-swim-v1-55586-v2-uploader completed after 225.93s with status: succeeded
Stopping job with name chaiml-evening-swim-v1-55586-v2-uploader
Pipeline stage VLLMUploader completed in 228.37s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.82s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-evening-swim-v1-55586-v2
Job chaiml-evening-swim-v1-35535-v2-uploader completed after 236.57s with status: succeeded
Waiting for inference service chaiml-evening-swim-v1-55586-v2 to be ready
Stopping job with name chaiml-evening-swim-v1-35535-v2-uploader
Pipeline stage VLLMUploader completed in 238.24s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.29s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-evening-swim-v1-35535-v2
Waiting for inference service chaiml-evening-swim-v1-35535-v2 to be ready
Inference service chaiml-evening-swim-v1-55586-v2 ready after 293.8804566860199s
Pipeline stage VLLMDeployer completed in 295.80s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0591979026794434s
Received healthy response to inference request in 2.4406800270080566s
Received healthy response to inference request in 2.236179828643799s
Received healthy response to inference request in 2.538482189178467s
Received healthy response to inference request in 2.3149259090423584s
Received healthy response to inference request in 2.457545042037964s
Received healthy response to inference request in 2.2838613986968994s
Received healthy response to inference request in 2.402106285095215s
Received healthy response to inference request in 2.4325594902038574s
Received healthy response to inference request in 2.388137102127075s
Received healthy response to inference request in 2.1609408855438232s
Inference service chaiml-evening-swim-v1-35535-v2 ready after 323.9244227409363s
Received healthy response to inference request in 2.2193682193756104s
Pipeline stage VLLMDeployer completed in 325.58s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2017226219177246s
Received healthy response to inference request in 2.2104713916778564s
Received healthy response to inference request in 2.345996379852295s
Received healthy response to inference request in 2.1812245845794678s
Received healthy response to inference request in 2.5197865962982178s
Received healthy response to inference request in 2.1270461082458496s
Received healthy response to inference request in 2.3546195030212402s
Received healthy response to inference request in 2.2504892349243164s
Received healthy response to inference request in 2.195831775665283s
Received healthy response to inference request in 2.1372458934783936s
Received healthy response to inference request in 2.1326565742492676s
Received healthy response to inference request in 2.2118701934814453s
Received healthy response to inference request in 2.0892136096954346s
Received healthy response to inference request in 2.370181083679199s
Received healthy response to inference request in 2.7852678298950195s
Received healthy response to inference request in 2.6671671867370605s
Received healthy response to inference request in 2.108774185180664s
Received healthy response to inference request in 2.290668487548828s
Received healthy response to inference request in 2.090057134628296s
Received healthy response to inference request in 2.204704761505127s
Received healthy response to inference request in 2.120394229888916s
Received healthy response to inference request in 2.319704294204712s
Received healthy response to inference request in 2.287963390350342s
Received healthy response to inference request in 2.848147392272949s
Received healthy response to inference request in 2.9763126373291016s
Received healthy response to inference request in 2.445187568664551s
Received healthy response to inference request in 2.2481088638305664s
Received healthy response to inference request in 2.193495988845825s
Received healthy response to inference request in 2.303438186645508s
Received healthy response to inference request in 2.1121253967285156s
Received healthy response to inference request in 2.313317060470581s
Received healthy response to inference request in 2.5187056064605713s
Received healthy response to inference request in 2.6223092079162598s
Received healthy response to inference request in 2.1856369972229004s
Received healthy response to inference request in 2.389063835144043s
Received healthy response to inference request in 2.2641050815582275s
30 requests
0 failed requests
5th percentile: 2.1453845143318175
10th percentile: 2.1831673860549925
20th percentile: 2.2005444526672364
30th percentile: 2.231136345863342
Received healthy response to inference request in 2.271352529525757s
40th percentile: 2.2879456520080566
50th percentile: 2.3328503370285034
60th percentile: 2.3773634910583494
70th percentile: 2.434995651245117
80th percentile: 2.4697771549224856
90th percentile: 2.5513506889343263
95th percentile: 2.7667062997817986
99th percentile: 2.9979932546615604
mean time: 2.3701475858688354
Pipeline stage StressChecker completed in 88.01s
Received healthy response to inference request in 3.13247013092041s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 2.2054123878479004s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.72s
Shutdown handler de-registered
chaiml-evening-swim-v1-_55586_v2 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 2.212911367416382s
Received healthy response to inference request in 2.476933479309082s
Received healthy response to inference request in 2.665884256362915s
Received healthy response to inference request in 2.2235605716705322s
Received healthy response to inference request in 2.3177406787872314s
Received healthy response to inference request in 2.2495808601379395s
Received healthy response to inference request in 2.263087749481201s
Received healthy response to inference request in 2.157444953918457s
Received healthy response to inference request in 2.12677264213562s
30 requests
0 failed requests
5th percentile: 2.0984798073768616
10th percentile: 2.1192322254180906
20th percentile: 2.135205936431885
30th percentile: 2.1981560468673704
40th percentile: 2.212494897842407
50th percentile: 2.248844861984253
60th percentile: 2.2663936614990234
70th percentile: 2.30640184879303
80th percentile: 2.406637763977051
90th percentile: 2.677822613716126
95th percentile: 2.890342473983764
99th percentile: 3.087184457778931
mean time: 2.3251906394958497
Pipeline stage StressChecker completed in 82.92s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.51s
Shutdown handler de-registered
chaiml-evening-swim-v1-_35535_v2 status is now deployed due to DeploymentManager action
chaiml-evening-swim-v1-_35535_v2 status is now inactive due to auto deactivation removed underperforming models