chaiml-evening-swim-v1-_35535

developer_uid: rirv938
submission_id: chaiml-evening-swim-v1-_35535_v1
model_name: chaiml-evening-swim-v1-_35535_v1
model_group: ChaiML/evening_swim_v1_g
status: inactive
timestamp: 2026-03-18T02:27:21+00:00
num_battles: 11550
num_wins: 5855
celo_rating: 1300.07
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/evening_swim_v1_glm_air-step1125-merged
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 9073971200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-evening-swim-v1-_35535_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/evening_swim_v1_glm_air-step1125-merged
model_size: 9B
ranking_group: single
us_pacific_date: 2026-03-17
win_ratio: 0.5069264069264069
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', 'You:', '</s>', '###', '<|im_start|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[gMASK]<sop><|system|>\nRespond as a high quality storyteller.<|user|>\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-evening-swim-v1-35535-v1-uploader
Waiting for job on chaiml-evening-swim-v1-35535-v1-uploader to finish
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-evening-swim-v1-55586-v1-uploader
Waiting for job on chaiml-evening-swim-v1-55586-v1-uploader to finish
chaiml-evening-swim-v1-35535-v1-uploader: Using quantization_mode: none
chaiml-evening-swim-v1-35535-v1-uploader: Downloading snapshot of ChaiML/evening_swim_v1_glm_air-step1125-merged...
chaiml-evening-swim-v1-55586-v1-uploader: Using quantization_mode: none
chaiml-evening-swim-v1-55586-v1-uploader: Downloading snapshot of ChaiML/evening_swim_v1_glm_air-step2250-merged...
chaiml-evening-swim-v1-55586-v1-uploader: Downloaded in 129.413s
chaiml-evening-swim-v1-35535-v1-uploader: Downloaded in 129.248s
chaiml-evening-swim-v1-35535-v1-uploader: Processed model ChaiML/evening_swim_v1_glm_air-step1125-merged in 205.612s
chaiml-evening-swim-v1-35535-v1-uploader: creating bucket guanaco-vllm-models
chaiml-evening-swim-v1-35535-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-35535-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-evening-swim-v1-35535-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-evening-swim-v1-35535-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-evening-swim-v1-35535-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-35535-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-evening-swim-v1-35535-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-35535-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-evening-swim-v1-35535-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-35535-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-evening-swim-v1-35535-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-35535-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-evening-swim-v1-35535-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-evening-swim-v1-35535-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-evening-swim-v1-35535-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-evening-swim-v1-35535-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-evening-swim-v1-35535-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-evening-swim-v1-35535-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/.gitattributes
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/tokenizer_config.json
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/args.json
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/README.md
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model.safetensors.index.json
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/chat_template.jinja
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/config.json
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/tokenizer.json
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/special_tokens_map.json
chaiml-evening-swim-v1-55586-v1-uploader: Processed model ChaiML/evening_swim_v1_glm_air-step2250-merged in 205.474s
chaiml-evening-swim-v1-55586-v1-uploader: creating bucket guanaco-vllm-models
chaiml-evening-swim-v1-55586-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-evening-swim-v1-55586-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-evening-swim-v1-55586-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-evening-swim-v1-55586-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-evening-swim-v1-55586-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-evening-swim-v1-55586-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-evening-swim-v1-55586-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-evening-swim-v1-55586-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-evening-swim-v1-55586-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-evening-swim-v1-55586-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-evening-swim-v1-55586-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-evening-swim-v1-55586-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-evening-swim-v1-55586-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-evening-swim-v1-55586-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/README.md
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/tokenizer_config.json
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/chat_template.jinja
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/args.json
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/special_tokens_map.json
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model.safetensors.index.json
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/config.json
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/.gitattributes
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/tokenizer.json
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00043-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00043-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00024-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00021-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00028-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00014-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00037-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00035-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00035-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00040-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00030-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00013-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00007-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00036-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00004-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00010-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00010-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00014-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00013-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00031-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00036-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00008-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00027-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00033-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00033-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00025-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00018-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00019-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00016-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00007-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00032-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00006-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00041-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00001-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00005-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00026-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00015-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00024-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00037-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00002-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00042-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00040-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00021-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00022-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00028-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00003-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00029-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00039-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00039-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00023-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00012-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00038-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00038-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00020-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00034-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00032-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00017-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00006-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00011-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00011-of-00043.safetensors
chaiml-evening-swim-v1-35535-v1-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-35535-v1/default/model-00030-of-00043.safetensors
chaiml-evening-swim-v1-55586-v1-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-evening-swim-v1-55586-v1/default/model-00012-of-00043.safetensors
Job chaiml-evening-swim-v1-35535-v1-uploader completed after 310.68s with status: succeeded
Job chaiml-evening-swim-v1-55586-v1-uploader completed after 305.54s with status: succeeded
Stopping job with name chaiml-evening-swim-v1-35535-v1-uploader
Stopping job with name chaiml-evening-swim-v1-55586-v1-uploader
Pipeline stage VLLMUploader completed in 312.73s
Pipeline stage VLLMUploader completed in 307.65s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.02s
Pipeline stage VLLMTemplater completed in 1.80s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Running pipeline stage VLLMDeployer
Creating inference service chaiml-evening-swim-v1-55586-v1
Creating inference service chaiml-evening-swim-v1-35535-v1
Waiting for inference service chaiml-evening-swim-v1-55586-v1 to be ready
Waiting for inference service chaiml-evening-swim-v1-35535-v1 to be ready
Inference service chaiml-evening-swim-v1-55586-v1 ready after 293.7539839744568s
Pipeline stage VLLMDeployer completed in 296.32s
Inference service chaiml-evening-swim-v1-35535-v1 ready after 294.4955098628998s
run pipeline stage %s
Pipeline stage VLLMDeployer completed in 297.23s
Running pipeline stage StressChecker
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.481262445449829s
Received healthy response to inference request in 2.956655263900757s
Received healthy response to inference request in 2.4149012565612793s
Received healthy response to inference request in 2.9410879611968994s
Received healthy response to inference request in 2.66408634185791s
Received healthy response to inference request in 2.2880606651306152s
Received healthy response to inference request in 2.1756606101989746s
Received healthy response to inference request in 2.2924723625183105s
Received healthy response to inference request in 2.318743944168091s
Received healthy response to inference request in 2.269627571105957s
Received healthy response to inference request in 2.202385663986206s
Received healthy response to inference request in 2.4750959873199463s
Received healthy response to inference request in 2.750593662261963s
Received healthy response to inference request in 2.3561456203460693s
Received healthy response to inference request in 2.328314781188965s
Received healthy response to inference request in 2.3829524517059326s
Received healthy response to inference request in 2.4840188026428223s
Received healthy response to inference request in 2.23325252532959s
Received healthy response to inference request in 2.2124247550964355s
Received healthy response to inference request in 2.3334712982177734s
Received healthy response to inference request in 2.5320346355438232s
Received healthy response to inference request in 2.34725022315979s
Received healthy response to inference request in 2.2516539096832275s
Received healthy response to inference request in 2.443293571472168s
Received healthy response to inference request in 2.7248551845550537s
Received healthy response to inference request in 2.344754695892334s
Received healthy response to inference request in 2.342811107635498s
Received healthy response to inference request in 2.261054039001465s
Received healthy response to inference request in 2.368095874786377s
Received healthy response to inference request in 2.3248403072357178s
Received healthy response to inference request in 2.3226163387298584s
Received healthy response to inference request in 2.2672643661499023s
Received healthy response to inference request in 2.358992338180542s
Received healthy response to inference request in 2.376335859298706s
Received healthy response to inference request in 2.71879506111145s
Received healthy response to inference request in 2.278311252593994s
Received healthy response to inference request in 2.2025539875030518s
Received healthy response to inference request in 2.411595106124878s
Received healthy response to inference request in 2.3334643840789795s
Received healthy response to inference request in 3.15004825592041s
Received healthy response to inference request in 2.36262845993042s
Received healthy response to inference request in 2.200690507888794s
Received healthy response to inference request in 2.1890621185302734s
Received healthy response to inference request in 2.201711654663086s
Received healthy response to inference request in 2.33022141456604s
Received healthy response to inference request in 2.1788434982299805s
Received healthy response to inference request in 2.170441150665283s
Received healthy response to inference request in 2.576338529586792s
Received healthy response to inference request in 2.2601096630096436s
Received healthy response to inference request in 2.1454501152038574s
Received healthy response to inference request in 2.225510358810425s
Received healthy response to inference request in 2.4734344482421875s
Received healthy response to inference request in 2.250500202178955s
Received healthy response to inference request in 2.256711483001709s
Received healthy response to inference request in 2.274168014526367s
Received healthy response to inference request in 2.4617176055908203s
Received healthy response to inference request in 2.1906871795654297s
Received healthy response to inference request in 2.1991453170776367s
Received healthy response to inference request in 2.786473274230957s
30 requests
0 failed requests
5th percentile: 2.181691288948059
10th percentile: 2.190524673461914
20th percentile: 2.202520322799683
30th percentile: 2.243003249168396
Received healthy response to inference request in 2.4210433959960938s
40th percentile: 2.2685446739196777
30 requests
50th percentile: 2.3254655599594116
0 failed requests
60th percentile: 2.3372030735015867
5th percentile: 2.1886746525764464
70th percentile: 2.364268684387207
10th percentile: 2.2016095399856566
80th percentile: 2.493621969223023
20th percentile: 2.2601855278015135
90th percentile: 2.7194010734558107
30th percentile: 2.275706148147583
95th percentile: 2.7390113472938538
40th percentile: 2.311893129348755
99th percentile: 3.2693684983253486
50th percentile: 2.346002459526062
mean time: 2.3880246321360272
60th percentile: 2.378982496261597
Pipeline stage StressChecker completed in 93.15s
70th percentile: 2.427718448638916
run pipeline stage %s
80th percentile: 2.4737667560577394
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
90th percentile: 2.8019347429275516
run_pipeline:run_in_cloud %s
95th percentile: 2.949649977684021
starting trigger_guanaco_pipeline args=%s
99th percentile: 3.093964288234711
mean time: 2.4145327965418497
triggered trigger_guanaco_pipeline args=%s
Pipeline stage StressChecker completed in 95.55s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.79s
run pipeline stage %s
Shutdown handler de-registered
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
chaiml-evening-swim-v1-_55586_v1 status is now deployed due to DeploymentManager action
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.21s
Shutdown handler de-registered
chaiml-evening-swim-v1-_35535_v1 status is now deployed due to DeploymentManager action
chaiml-evening-swim-v1-_35535_v1 status is now inactive due to auto deactivation removed underperforming models