developer_uid: chai_backend_admin
submission_id: chaiml-gspo-glm47-think_38274_v2
model_name: chaiml-gspo-glm47-think_38274_v2
model_group: ChaiML/gspo-glm47-thinki
status: inactive
timestamp: 2026-04-14T03:57:02+00:00
num_battles: 11493
num_wins: 6335
celo_rating: 0.0
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/gspo-glm47-thinking-rm-kimi-pony-euqal-apr04-step600
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-gspo-glm47-think_38274_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/gspo-glm47-thinking-rm-kimi-pony-euqal-apr04-step600
model_size: 24B
ranking_group: single
us_pacific_date: 2026-04-13
win_ratio: 0.5512050813538676
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '<|im_end|>', '</s>', '<|assistant|>', '<|user|>'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>{message}', 'user_template': '<|user|>{message}', 'response_template': '<|assistant|></think>', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gspo-glm47-think-38274-v2-uploader
Waiting for job on chaiml-gspo-glm47-think-38274-v2-uploader to finish
chaiml-gspo-glm47-think-38274-v2-uploader: Using quantization_mode: fp8
chaiml-gspo-glm47-think-38274-v2-uploader: Checking if ChaiML/gspo-glm47-thinking-rm-kimi-pony-euqal-apr04-step600-FP8 already exists in ChaiML
chaiml-gspo-glm47-think-38274-v2-uploader: Model already exists. Downloading to /tmp/model_output...
chaiml-gspo-glm47-think-38274-v2-uploader: Downloading snapshot of ChaiML/gspo-glm47-thinking-rm-kimi-pony-euqal-apr04-step600-FP8...
2026-04-14T01:51:07.220065+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T01:52:07.308052+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T01:53:07.389445+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T01:54:07.470457+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
chaiml-gspo-glm47-think-38274-v2-uploader: Downloaded in 246.434s
chaiml-gspo-glm47-think-38274-v2-uploader: Processed model ChaiML/gspo-glm47-thinking-rm-kimi-pony-euqal-apr04-step600 in 249.063s
chaiml-gspo-glm47-think-38274-v2-uploader: creating bucket guanaco-vllm-models
chaiml-gspo-glm47-think-38274-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-think-38274-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-gspo-glm47-think-38274-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-gspo-glm47-think-38274-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
2026-04-14T01:55:07.555337+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
chaiml-gspo-glm47-think-38274-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-think-38274-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-gspo-glm47-think-38274-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-think-38274-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-gspo-glm47-think-38274-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-think-38274-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-gspo-glm47-think-38274-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-think-38274-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-gspo-glm47-think-38274-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-gspo-glm47-think-38274-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-gspo-glm47-think-38274-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-gspo-glm47-think-38274-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-gspo-glm47-think-38274-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-gspo-glm47-think-38274-v2-uploader: uploading /tmp/model_output to s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/chat_template.jinja
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/.gitattributes
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/config.json
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/recipe.yaml
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model.safetensors.index.json
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/tokenizer.json
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/generation_config.json
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/tokenizer_config.json
2026-04-14T01:56:07.633654+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
chaiml-gspo-glm47-think-38274-v2-uploader: DEBUG retryable error: InternalError: We encountered an internal error, please try again.
chaiml-gspo-glm47-think-38274-v2-uploader: 	status code: 500, request id: 9301b065-70ce-9d37-9dc5-42fa0d0c2215, host id: 
2026-04-14T01:57:07.744300+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T01:58:07.853954+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00015-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00015-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00011-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00011-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00014-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00014-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00009-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00009-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00012-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00012-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00003-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00003-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00010-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00010-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00013-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00013-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00005-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00005-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00006-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00006-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00008-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00008-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00004-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00004-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00007-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00007-of-00015.safetensors
chaiml-gspo-glm47-think-38274-v2-uploader: cp /tmp/model_output/model-00002-of-00015.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-think-38274-v2/default/model-00002-of-00015.safetensors
2026-04-14T01:59:07.974853+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
Job chaiml-gspo-glm47-think-38274-v2-uploader completed after 552.32s with status: succeeded
Stopping job with name chaiml-gspo-glm47-think-38274-v2-uploader
Pipeline stage VLLMUploader completed in 552.81s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.16s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 3.42s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-gspo-glm47-think-38274-v2
Waiting for inference service chaiml-gspo-glm47-think-38274-v2 to be ready
2026-04-14T02:00:08.073660+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T02:01:08.276702+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T02:02:08.409326+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T02:03:08.562582+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T02:04:08.701545+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T02:05:08.828189+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T02:06:08.927624+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
2026-04-14T02:07:09.017344+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
Inference service chaiml-gspo-glm47-think-38274-v2 ready after 490.62594294548035s
Pipeline stage VLLMDeployer completed in 491.05s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.449131965637207s
Received healthy response to inference request in 2.083496332168579s
Received healthy response to inference request in 1.9846930503845215s
Received healthy response to inference request in 9.027390956878662s
Received healthy response to inference request in 1.981477975845337s
Received healthy response to inference request in 2.0875461101531982s
Received healthy response to inference request in 2.033693313598633s
Received healthy response to inference request in 2.0348141193389893s
2026-04-14T02:08:09.114455+00:00 monitor updated for chaiml-gspo-glm47-think_38274_v2
Received healthy response to inference request in 1.979806661605835s
Received healthy response to inference request in 2.1269426345825195s
Received healthy response to inference request in 2.048186779022217s
Received healthy response to inference request in 2.0011825561523438s
Received healthy response to inference request in 1.9387118816375732s
Received healthy response to inference request in 2.0051169395446777s
Received healthy response to inference request in 2.1771903038024902s
Received healthy response to inference request in 2.010049343109131s
Received healthy response to inference request in 2.312352418899536s
Received healthy response to inference request in 2.029391050338745s
Received healthy response to inference request in 2.0913023948669434s
Received healthy response to inference request in 1.9911139011383057s
Received healthy response to inference request in 2.062962770462036s
Received healthy response to inference request in 2.2972233295440674s
Received healthy response to inference request in 9.131689548492432s
Received healthy response to inference request in 2.209702491760254s
Received healthy response to inference request in 2.0377135276794434s
Received healthy response to inference request in 2.0516982078552246s
Received healthy response to inference request in 2.076751232147217s
Received healthy response to inference request in 2.0750720500946045s
Received healthy response to inference request in 2.098637580871582s
Received healthy response to inference request in 2.276495933532715s
30 requests
0 failed requests
5th percentile: 1.9805587530136108
10th percentile: 1.984371542930603
20th percentile: 2.004330062866211
30th percentile: 2.0324026346206665
40th percentile: 2.0439974784851076
50th percentile: 2.0690174102783203
60th percentile: 2.085116243362427
70th percentile: 2.1071290969848633
80th percentile: 2.223061180114746
90th percentile: 2.9838562726974582
95th percentile: 9.084755182266235
99th percentile: 9.357073664665222
mean time: 2.790384578704834
Pipeline stage StressChecker completed in 87.40s
Shutdown handler de-registered
chaiml-gspo-glm47-think_38274_v2 status is now deployed due to DeploymentManager action
chaiml-gspo-glm47-think_38274_v2 status is now inactive due to auto deactivation removed underperforming models