developer_uid: chai_backend_admin
submission_id: chaiml-glm-air-4-5-sft-_93550_v9
model_name: chaiml-glm-air-4-5-sft-_93550_v9
model_group: ChaiML/glm_air_4_5_sft_2
status: torndown
timestamp: 2026-03-03T08:22:06+00:00
num_battles: 12524
num_wins: 6883
celo_rating: 1327.52
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/glm_air_4_5_sft_20260227_q235_e2
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 9073971200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-glm-air-4-5-sft-_93550_v9
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/glm_air_4_5_sft_20260227_q235_e2
model_size: 9B
ranking_group: single
us_pacific_date: 2026-02-28
win_ratio: 0.5495847971893963
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '###', '</s>', '<|im_start|>', 'You:'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[gMASK]<sop><|system|>\nRespond as a high quality storyteller.<|user|>\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-glm-air-4-5-sft-93550-v9-uploader
Waiting for job on chaiml-glm-air-4-5-sft-93550-v9-uploader to finish
chaiml-glm-air-4-5-sft-93550-v9-uploader: Using quantization_mode: none
chaiml-glm-air-4-5-sft-93550-v9-uploader: Downloading snapshot of ChaiML/glm_air_4_5_sft_20260227_q235_e2...
chaiml-glm-air-4-5-sft-93550-v9-uploader: Downloaded in 70.086s
chaiml-glm-air-4-5-sft-93550-v9-uploader: Processed model ChaiML/glm_air_4_5_sft_20260227_q235_e2 in 145.474s
chaiml-glm-air-4-5-sft-93550-v9-uploader: creating bucket guanaco-vllm-models
chaiml-glm-air-4-5-sft-93550-v9-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-93550-v9-uploader: RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-glm-air-4-5-sft-93550-v9-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-glm-air-4-5-sft-93550-v9-uploader: RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-glm-air-4-5-sft-93550-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-93550-v9-uploader: invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-glm-air-4-5-sft-93550-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-93550-v9-uploader: invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-glm-air-4-5-sft-93550-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-93550-v9-uploader: if re.search("-\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-93550-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-93550-v9-uploader: if re.search("\.\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-93550-v9-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-glm-air-4-5-sft-93550-v9-uploader: _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-glm-air-4-5-sft-93550-v9-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-glm-air-4-5-sft-93550-v9-uploader: wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-glm-air-4-5-sft-93550-v9-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-glm-air-4-5-sft-93550-v9-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/args.json
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/README.md
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/.gitattributes
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/chat_template.jinja
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/config.json
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model.safetensors.index.json
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/tokenizer_config.json
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/special_tokens_map.json
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/tokenizer.json
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00043-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00040-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00034-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00002-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00032-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00031-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00017-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00039-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00039-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00001-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00027-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00011-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00028-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00023-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00019-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00025-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00041-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00005-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00014-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00036-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00012-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00024-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00004-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00013-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00022-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00009-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00009-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00021-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00029-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00018-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00016-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00008-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00026-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00007-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00033-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00033-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00003-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00020-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00030-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00006-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00037-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00010-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00010-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00015-of-00043.safetensors
chaiml-glm-air-4-5-sft-93550-v9-uploader: cp /dev/shm/model_output/model-00035-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-93550-v9/default/model-00035-of-00043.safetensors
Job chaiml-glm-air-4-5-sft-93550-v9-uploader completed after 226.0s with status: succeeded
Stopping job with name chaiml-glm-air-4-5-sft-93550-v9-uploader
Pipeline stage VLLMUploader completed in 226.50s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.29s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-glm-air-4-5-sft-93550-v9
Waiting for inference service chaiml-glm-air-4-5-sft-93550-v9 to be ready
Inference service chaiml-glm-air-4-5-sft-93550-v9 ready after 461.0051670074463s
Pipeline stage VLLMDeployer completed in 461.63s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.7003581523895264s
Received healthy response to inference request in 1.650987148284912s
Received healthy response to inference request in 1.569727897644043s
Received healthy response to inference request in 1.6773388385772705s
Received healthy response to inference request in 1.8034021854400635s
Received healthy response to inference request in 1.6637351512908936s
Received healthy response to inference request in 1.6750624179840088s
Received healthy response to inference request in 1.618499755859375s
Received healthy response to inference request in 1.6866378784179688s
Received healthy response to inference request in 1.77443265914917s
Received healthy response to inference request in 1.64461088180542s
Received healthy response to inference request in 1.6282331943511963s
Received healthy response to inference request in 1.7494511604309082s
Received healthy response to inference request in 1.6189417839050293s
Received healthy response to inference request in 1.8263418674468994s
Received healthy response to inference request in 1.6860430240631104s
Received healthy response to inference request in 1.6914117336273193s
Received healthy response to inference request in 1.6762864589691162s
Received healthy response to inference request in 1.7894277572631836s
Received healthy response to inference request in 1.8628590106964111s
Received healthy response to inference request in 1.8033740520477295s
Received healthy response to inference request in 1.6409950256347656s
Received healthy response to inference request in 1.7445476055145264s
Received healthy response to inference request in 1.7192344665527344s
Received healthy response to inference request in 1.6774587631225586s
Received healthy response to inference request in 1.6799712181091309s
Received healthy response to inference request in 1.7815022468566895s
Received healthy response to inference request in 1.910217523574829s
Received healthy response to inference request in 1.8823645114898682s
Received healthy response to inference request in 1.8687455654144287s
30 requests
0 failed requests
5th percentile: 1.6186986684799194
10th percentile: 1.6273040533065797
20th percentile: 1.6497118949890137
30th percentile: 1.675919246673584
40th percentile: 1.678966236114502
50th percentile: 1.689024806022644
60th percentile: 1.729359722137451
70th percentile: 1.7765535354614257
80th percentile: 1.8033796787261962
90th percentile: 1.863447666168213
95th percentile: 1.8762359857559203
99th percentile: 1.9021401500701904
mean time: 1.7234066645304362
Pipeline stage StressChecker completed in 56.31s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
chaiml-glm-air-4-5-sft-_93550_v9 status is now deployed due to DeploymentManager action
chaiml-glm-air-4-5-sft-_93550_v9 status is now inactive due to auto deactivation removed underperforming models
chaiml-glm-air-4-5-sft-_93550_v9 status is now torndown due to DeploymentManager action