developer_uid: richhx
submission_id: chaiml-gspo-glm47-cas72_44260_v6
model_name: chaiml-gspo-glm47-cas72_44260_v6
model_group: ChaiML/gspo-glm47-cas72b
status: torndown
timestamp: 2026-04-05T08:23:01+00:00
num_battles: 10364
num_wins: 5753
celo_rating: 1335.66
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/gspo-glm47-cas72b-combine-rm82-kimi-data-step500-FP8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-gspo-glm47-cas72_44260_v6
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/gspo-glm47-cas72b-combine-rm82-kimi-data-step500-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-04-02
win_ratio: 0.5550945580856812
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|user|>', '</s>', '<|im_end|>', '####', '<|assistant|>'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n{bot_name}: {message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gspo-glm47-cas72-44260-v6-uploader
Waiting for job on chaiml-gspo-glm47-cas72-44260-v6-uploader to finish
chaiml-gspo-glm47-cas72-44260-v6-uploader: {repo_id} is already quantized
chaiml-gspo-glm47-cas72-44260-v6-uploader: Using quantization_mode: none
chaiml-gspo-glm47-cas72-44260-v6-uploader: Downloading snapshot of ChaiML/gspo-glm47-cas72b-combine-rm82-kimi-data-step500-FP8...
2026-04-02T05:42:36.869991+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
2026-04-02T05:43:36.963193+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
Failed to get response for submission chaiml-gspo-glm47-cas72_44260_v3: HTTPConnectionPool(host='chaiml-gspo-glm47-cas72-44260-v3-predictor.tenant-chaiml-guanaco.kchai-tensorwave-us-tus-1.chaiverse.com', port=80): Read timed out. (read timeout=20.0)
2026-04-02T05:44:37.055554+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
chaiml-gspo-glm47-cas72-44260-v6-uploader: Downloaded in 136.130s
2026-04-02T05:45:37.149637+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
Retrying (%r) after connection broken by '%r': %s
2026-04-02T05:46:37.238756+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
chaiml-gspo-glm47-cas72-44260-v6-uploader: Processed model ChaiML/gspo-glm47-cas72b-combine-rm82-kimi-data-step500-FP8 in 261.744s
chaiml-gspo-glm47-cas72-44260-v6-uploader: creating bucket guanaco-vllm-models
chaiml-gspo-glm47-cas72-44260-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44260-v6-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-gspo-glm47-cas72-44260-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-gspo-glm47-cas72-44260-v6-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-gspo-glm47-cas72-44260-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44260-v6-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-gspo-glm47-cas72-44260-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44260-v6-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-gspo-glm47-cas72-44260-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44260-v6-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-gspo-glm47-cas72-44260-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44260-v6-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-gspo-glm47-cas72-44260-v6-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-gspo-glm47-cas72-44260-v6-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-gspo-glm47-cas72-44260-v6-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-gspo-glm47-cas72-44260-v6-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-gspo-glm47-cas72-44260-v6-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-gspo-glm47-cas72-44260-v6-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/.gitattributes
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/generation_config.json
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/chat_template.jinja
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/config.json
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/tokenizer_config.json
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/recipe.yaml
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/special_tokens_map.json
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model.safetensors.index.json
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/tokenizer.json
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00072-of-00072.safetensors
2026-04-02T05:47:37.326976+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00071-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00039-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00011-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00012-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00025-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00033-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00006-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00015-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00026-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00010-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00028-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00046-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00018-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00070-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00016-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00022-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00014-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00002-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00038-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00023-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00007-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00032-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00009-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00048-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00020-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00042-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00017-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00027-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00040-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00060-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00044-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00001-of-00072.safetensors
chaiml-gspo-glm47-cas72-44260-v6-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44260-v6/default/model-00003-of-00072.safetensors
2026-04-02T05:48:37.446911+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
Job chaiml-gspo-glm47-cas72-44260-v6-uploader completed after 430.07s with status: succeeded
Stopping job with name chaiml-gspo-glm47-cas72-44260-v6-uploader
Pipeline stage VLLMUploader completed in 430.57s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.12s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.69s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-gspo-glm47-cas72-44260-v6
Waiting for inference service chaiml-gspo-glm47-cas72-44260-v6 to be ready
2026-04-02T05:49:37.588752+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
2026-04-02T05:50:37.714352+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
2026-04-02T05:51:37.811683+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
2026-04-02T05:52:37.914838+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
2026-04-02T05:53:38.046252+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
Inference service chaiml-gspo-glm47-cas72-44260-v6 ready after 301.3729772567749s
Pipeline stage VLLMDeployer completed in 302.45s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.259314775466919s
Received healthy response to inference request in 2.125354528427124s
Received healthy response to inference request in 9.19085955619812s
Received healthy response to inference request in 1.9681968688964844s
Received healthy response to inference request in 2.0369033813476562s
Received healthy response to inference request in 9.631550788879395s
Received healthy response to inference request in 9.194348573684692s
2026-04-02T05:54:38.147381+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
Received healthy response to inference request in 2.122036933898926s
Received healthy response to inference request in 2.0510408878326416s
Received healthy response to inference request in 2.1235082149505615s
Received healthy response to inference request in 1.9905614852905273s
Received healthy response to inference request in 2.3851425647735596s
Received healthy response to inference request in 1.990661859512329s
Received healthy response to inference request in 2.057896375656128s
Received healthy response to inference request in 2.0815627574920654s
Received healthy response to inference request in 2.1553430557250977s
Received healthy response to inference request in 2.1337480545043945s
Received healthy response to inference request in 2.235297441482544s
Received healthy response to inference request in 9.44017481803894s
Received healthy response to inference request in 2.1186954975128174s
Received healthy response to inference request in 2.1530046463012695s
Received healthy response to inference request in 2.040195941925049s
Received healthy response to inference request in 3.4827916622161865s
Received healthy response to inference request in 2.0636794567108154s
Received healthy response to inference request in 2.008344888687134s
Received healthy response to inference request in 2.0667922496795654s
Received healthy response to inference request in 2.2189035415649414s
Received healthy response to inference request in 2.0540719032287598s
Received healthy response to inference request in 1.9940626621246338s
Received healthy response to inference request in 2.5447399616241455s
30 requests
0 failed requests
5th percentile: 1.9906066536903382
10th percentile: 1.9937225818634032
20th percentile: 2.0395374298095703
30th percentile: 2.0567490339279173
40th percentile: 2.0756545543670653
50th percentile: 2.1227725744247437
60th percentile: 2.1414506912231444
70th percentile: 2.223821711540222
80th percentile: 2.7323503017425566
90th percentile: 9.200845193862914
95th percentile: 9.358787798881531
99th percentile: 9.576051757335662
mean time: 3.3639595111211142
Pipeline stage StressChecker completed in 104.80s
run pipeline stage %s
2026-04-02T05:55:38.258552+00:00 monitor updated for chaiml-gspo-glm47-cas72_44260_v6
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.08s
Shutdown handler de-registered
chaiml-gspo-glm47-cas72_44260_v6 status is now deployed due to DeploymentManager action
chaiml-gspo-glm47-cas72_44260_v6 status is now inactive due to auto deactivation removed underperforming models
chaiml-gspo-glm47-cas72_44260_v6 status is now torndown due to DeploymentManager action